-- Logs begin at Thu 2022-07-21 04:59:18 UTC, end at Thu 2022-07-21 05:55:23 UTC. -- Jul 21 05:25:32.541792 dv-cinder-850449-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 05:25:32.550936 dv-cinder-850449-1-smb devstack@keystone.service[80384]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 05:25:32.553532 dv-cinder-850449-1-smb devstack@keystone.service[80384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 05:25:32 2022] *** Jul 21 05:25:32.553669 dv-cinder-850449-1-smb devstack@keystone.service[80384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 05:25:32.553777 dv-cinder-850449-1-smb devstack@keystone.service[80384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: nodename: dv-cinder-850449-1-smb Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: machine: x86_64 Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: clock source: unix Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: pcre jit disabled Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: detected number of CPU cores: 4 Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: current working directory: / Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: detected binary path: /usr/bin/uwsgi-core Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: your processes number limit is 47680 Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: your memory page size is 4096 bytes Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: detected max file descriptor number: 2048 Jul 21 05:25:32.553901 dv-cinder-850449-1-smb devstack@keystone.service[80384]: lock engine: pthread robust mutexes Jul 21 05:25:32.554571 dv-cinder-850449-1-smb devstack@keystone.service[80384]: thunder lock: enabled Jul 21 05:25:32.554571 dv-cinder-850449-1-smb devstack@keystone.service[80384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 05:25:32.554571 dv-cinder-850449-1-smb devstack@keystone.service[80384]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 05:25:32.602986 dv-cinder-850449-1-smb devstack@keystone.service[80384]: Python main interpreter initialized at 0x55a3a97f79c0 Jul 21 05:25:32.602986 dv-cinder-850449-1-smb devstack@keystone.service[80384]: python threads support enabled Jul 21 05:25:32.602986 dv-cinder-850449-1-smb devstack@keystone.service[80384]: your server socket listen backlog is limited to 100 connections Jul 21 05:25:32.602986 dv-cinder-850449-1-smb devstack@keystone.service[80384]: your mercy for graceful operations on workers is 90 seconds Jul 21 05:25:32.603325 dv-cinder-850449-1-smb devstack@keystone.service[80384]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 05:25:32.603400 dv-cinder-850449-1-smb devstack@keystone.service[80384]: *** Operational MODE: preforking *** Jul 21 05:25:32.603657 dv-cinder-850449-1-smb devstack@keystone.service[80384]: *** uWSGI is running in multiple interpreter mode *** Jul 21 05:25:32.603657 dv-cinder-850449-1-smb devstack@keystone.service[80384]: spawned uWSGI master process (pid: 80384) Jul 21 05:25:32.603858 dv-cinder-850449-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 05:25:32.605088 dv-cinder-850449-1-smb devstack@keystone.service[80384]: spawned uWSGI worker 1 (pid: 80393, cores: 1) Jul 21 05:25:32.605088 dv-cinder-850449-1-smb devstack@keystone.service[80384]: spawned uWSGI worker 2 (pid: 80394, cores: 1) Jul 21 05:25:32.605088 dv-cinder-850449-1-smb devstack@keystone.service[80384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 05:25:37.952643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:25:37.952643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: from cryptography.utils import int_from_bytes Jul 21 05:25:37.953492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:25:37.953492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: from cryptography.utils import int_from_bytes Jul 21 05:25:37.955363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:25:37.955363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: from cryptography.utils import int_from_bytes Jul 21 05:25:37.955856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:25:37.955856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: from cryptography.utils import int_from_bytes Jul 21 05:25:38.001411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 05:25:38.001591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 05:25:38.001753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] command line args: [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 05:25:38.002044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 05:25:38.002207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ================================================================================ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 05:25:38.002474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] admin_token = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.002726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config_dir = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.002856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.003021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 05:25:38.003109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config_source = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.003227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] debug = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.003304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 05:25:38.003379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] command line args: [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 05:25:38.003444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.003703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 05:25:38.003772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.003831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ================================================================================ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 05:25:38.003900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] admin_token = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] config_dir = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] config_source = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.004917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_config_append = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] debug = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_dir = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.005968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_config_append = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.006941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_dir = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.007992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.008961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] publish_errors = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.009917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] standard_threads = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.010888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_journal = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_json = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.011840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_stderr = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.012047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] publish_errors = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.012170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_syslog = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.012322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.012399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.012568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.012776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.012915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.013010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.013091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.013320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.013441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.013538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.013755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.013891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.014063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.014185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] standard_threads = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.014275 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.014454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.014587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.014807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.014930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.015020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.015097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.015301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.015424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] use_journal = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.015521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.015597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] use_json = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.015778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.015861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] use_stderr = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.016032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.016115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] use_syslog = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.016295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.016384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:25:38.016568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.016803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.016897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.017918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.018994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.019074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.019299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.019380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.019539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.019778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.019902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.020033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.020222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.020345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.020521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.020705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.020836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.021120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.021204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.021452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.021560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.021704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.021934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.022966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.023116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.023312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.023390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.023566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.023736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.023822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.024943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.025113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.025298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.025400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.025580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.025662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.026103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.026360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.026614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.026847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.027078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.027308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.027545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.027794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.028042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.028272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.028522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.028772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.029018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.029255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.029508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.029740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.029978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.030258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.030432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.030666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.030745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.030932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.031975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.032138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.033949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.034979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.035886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.036893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037710 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.037935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.038965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.039900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.040952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.041927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.042982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.external = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.043890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.password = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.token = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.044960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.045913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.046964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.external = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.047993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.password = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.token = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.048943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.049937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.050958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.051996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.052980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.053898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.054911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.055918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.056864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.057897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.058913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.059931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.060900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.061784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.062904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.063888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.064845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.065974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.066189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.066305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.066419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.066562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.066680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.066894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.067815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.068021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.068137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.068262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.068375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.068916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.069970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070759 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.070933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.071888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.072924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.073883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.074988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.075993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.076980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.077910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.078155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.078334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.078508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.078624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.078847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.078995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.079943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.080934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.081921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.082903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.083035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.083152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.083264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.083632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.083749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.083907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.084891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.085976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.086973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.087997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.088958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.089984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.090971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.091095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.091211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.091348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] role.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.091498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.091618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 05:25:38.091730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] role.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.092018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.092301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.092575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.092824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.093071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.093374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.093622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.093859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.094103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.094465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.094851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.095227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.095602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.095973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.096684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.097023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.097280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.097527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.097783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.098076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.098312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.098561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.098833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.099206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.099565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.099921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.100272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.100682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.101138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.101576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.101823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.102060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.102303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.102585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.102826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.103072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.103307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.103691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.104079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.104442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.104851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.105224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.105635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.106038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.106320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.106554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.106798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.107089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.107322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.107561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.107860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.108254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.108661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.109043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.109408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.109775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.110164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.110574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.110932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.111273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.111549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.111787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.112028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.112261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.112540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.112776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.113016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.113244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.113481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.113714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:25:38.113884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 05:25:38.122835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.123069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.123290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.131578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.139760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.139988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.140213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.148580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.159130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.159368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.166434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.166659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.304622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.305043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.353124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.353359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.354122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.354350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.424265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.424442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.424603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.424729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.424934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.425808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.450531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.450683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.450856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.451969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.452060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.463088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.463215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.476905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.477533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 05:25:38.494660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.494876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 05:25:38.495196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.495399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 05:25:38.495557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.495652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.495791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 05:25:38.495916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.496113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.496229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.496325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 05:25:38.496600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.496723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.496839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.497109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.497359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.507336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.507607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.507869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.508145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.508414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.508700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.508967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.509238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.516194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.517277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.519582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.519853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.520127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.520409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.520559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.520684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.520817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.520971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.521934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.522022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.522230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.522356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.522506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.522773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.523070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.523318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.548668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.549556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.550249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.550522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.551155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.551431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.555832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.556063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.556319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.556661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.556941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.557218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.563647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.563924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.564404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.564825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.568344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.569018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.569296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.569567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.569815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.569941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.570918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.571187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.571446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.571705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.589060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.589326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.590472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.590745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.593826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.595518 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.597464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.597751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.599134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.599421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.602813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.604433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.606623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.608537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.610108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.610405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.610697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.610968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.611240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.611508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.612223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.612519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.612823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.613100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.613375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.613641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.630487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.630767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.631010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.631308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.632415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.632807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.633076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.633339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.639158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.640874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.641139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.641307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.642825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.643096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.644133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.644425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.644728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.645003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.645391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.646116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.646403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.646673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.646946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.647227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.658599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.658839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.659142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.659421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.659698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.659961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.660228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.660470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.660771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.661044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.661313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.661583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.661865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.662133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.679262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.681150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.682532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.684364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.685811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.687394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.687623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.689050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.689256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.689426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.689724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.690862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.691143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.691429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.697401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.699299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.699494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.701236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.702509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.702792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.703070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.703343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.704429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.704736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.705016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.705294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.712501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.712785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.713059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.714441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.714720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.714996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.720848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.721118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.721395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.721662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.721928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.722184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.722469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.722743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.722882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 05:25:38.723021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.723939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.724068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.724145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.724366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.724516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.724721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.724974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.725237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.725505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.725761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.726070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.726334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 05:25:38.761740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3a97f79c0 pid: 80394 (default app) Jul 21 05:25:38.765150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787b211-d4e8-4584-bd7f-032005875748 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:38.765435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787b211-d4e8-4584-bd7f-032005875748 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:38.765706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787b211-d4e8-4584-bd7f-032005875748 None None] PATH_INFO: `/v3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:38.768104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3a97f79c0 pid: 80393 (default app) Jul 21 05:25:38.769904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Thu Jul 21 05:25:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:46.418125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:46.419028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:46.419028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:46.426076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:46.431471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:46.431915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:46.432001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:46.499961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: INFO dbcounter [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] Registered counter for database keystone Jul 21 05:25:46.526043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG oslo_db.sqlalchemy.engines [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:25:46.537554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writer thread running {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:25:46.722733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG passlib.handlers.bcrypt [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80394) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 05:25:46.723078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG passlib.handlers.bcrypt [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80394) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 05:25:46.778165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:46.779765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:46.907385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 21 05:25:47.134156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:47.209730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: INFO dbcounter [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] Registered counter for database keystone Jul 21 05:25:47.231252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG oslo_db.sqlalchemy.engines [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:25:47.239392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writer thread running {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:25:47.357078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62c6a9-d2b2-45ec-ad19-06847340d43e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:47.362592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:47.363258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:47.363538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:47.363818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:47.372427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:47.423541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 05:25:47.424126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3caf66c-449d-45c7-896e-c54d71c154bd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:47.434524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jul 21 05:25:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:25:47.441627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:47.458190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d92a0d-0463-4b7b-a07b-d161a6d18e8c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:47.463982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:47.465132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:47.465417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:47.465690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] PATH_INFO: `/v3/projects/7cee36c3beac431ba01428ee854cc3a6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:47.467345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=7cee36c3beac431ba01428ee854cc3a6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:47.519860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 05:25:47.520193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d3465-b4e3-4e3f-a0e3-fa1e70eb26b2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:47.525413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Thu Jul 21 05:25:47 2022] GET /identity/v3/projects/7cee36c3beac431ba01428ee854cc3a6 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:49.506253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11349f-e088-4057-82f5-3b8bceb338a0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:49.506795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11349f-e088-4057-82f5-3b8bceb338a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:49.506795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11349f-e088-4057-82f5-3b8bceb338a0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:49.510998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:25:49.518098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:49.518840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:49.519106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:49.541396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:49.542940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:49.556108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 05:25:49.579816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11349f-e088-4057-82f5-3b8bceb338a0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:49.594012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11349f-e088-4057-82f5-3b8bceb338a0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:49.599388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879acd-896d-4e95-bd94-563f32e53e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:49.600025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879acd-896d-4e95-bd94-563f32e53e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:49.600306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879acd-896d-4e95-bd94-563f32e53e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:49.600622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879acd-896d-4e95-bd94-563f32e53e68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:49.609284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17879acd-896d-4e95-bd94-563f32e53e68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:49.611086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17879acd-896d-4e95-bd94-563f32e53e68 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:49.620377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Thu Jul 21 05:25:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:25:49.626396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:49.642323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0481875-5066-436a-ba03-75f8b1ce926c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:49.650302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae0042-e412-42ef-b684-3f8c0f14ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:49.651172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0042-e412-42ef-b684-3f8c0f14ab83 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:49.651454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0042-e412-42ef-b684-3f8c0f14ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:49.651731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0042-e412-42ef-b684-3f8c0f14ab83 admin admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:49.653310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae0042-e412-42ef-b684-3f8c0f14ab83 admin admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:49.655165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae0042-e412-42ef-b684-3f8c0f14ab83 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:49.656777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Thu Jul 21 05:25:49 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:51.730785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a891-4cc1-4bba-b691-8c26e1cdd4a3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:51.731308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a891-4cc1-4bba-b691-8c26e1cdd4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:51.731308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099a891-4cc1-4bba-b691-8c26e1cdd4a3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:51.732627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:25:51.737835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:51.738241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:51.738393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:51.755928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:51.757151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:51.811072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37ca1-0a8c-410a-9948-a239d9020a3a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:51.811353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37ca1-0a8c-410a-9948-a239d9020a3a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:51.811650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37ca1-0a8c-410a-9948-a239d9020a3a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:51.813031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:51.818163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:51.818455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:51.818734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:51.842902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:51.860055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG passlib.handlers.bcrypt [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80393) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 05:25:51.860500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG passlib.handlers.bcrypt [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80393) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 05:25:51.865954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:51.890317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:51.905493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:51.907075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:51.977003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f4bb0-c9f1-461a-b27a-b8363e222df0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.008720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:52.013672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.014878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.015313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.015729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.031027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.031997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:25:52.047683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:25:52.048640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:25:52.049437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:25:52.056409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.133258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc040aa-153a-46e9-9530-d58baefd3ae9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.135576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:52.141938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:52.160682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f019-4360-4edb-b7db-2739d9c626b8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.172635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.173643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.174022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.174356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.194380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.195061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.195349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.195680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.196720 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:52.196826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.198198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.210131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:52.215786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.242849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.244401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.320810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaeed1-63f3-4ba4-a6e8-bc75d5fc9ec8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.341347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:25:52.347780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.351095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:52.357701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.358580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.358866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.359136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.360357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.361873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.363508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:52.369533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.384531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:52.449135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac2db-9c09-422b-a24f-2fc41ddf4bd3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.470663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afe287-65fc-403f-ba07-e922b1039c5d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.482216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.483024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.483297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.483568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.505108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.505394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.506194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.506478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.506754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.506892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.507962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.509450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.511070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:52.517096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:25:52.527220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:25:52.528112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:25:52.529094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:25:52.529094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:25:52.529094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:25:52.529094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:25:52.529094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:25:52.534131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:52.590527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:52.601894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:52.621027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cae7b5-4307-4215-84b8-7f8fe8ac06ae None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.635980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f32e11-4760-40b4-93dc-f4e012888a1c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:52.653716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.654376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.654657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.654912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.655734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.domain.id=default, user.id=0df58371c35d43d69765edab78a9d01a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:52.656042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.657532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9762e9-6558-4837-8054-0097f363f691 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.664128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/role_assignments?user.id=0df58371c35d43d69765edab78a9d01a&scope.domain.id=default&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:52.670660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:52.671357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:52.671641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:52.671918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:52.672700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:52.673019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:52.674489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585ae45-3a11-47c0-9596-93b7abf3dd24 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:52.694934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:54.838621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903dbda-ff6a-4931-b7fb-4b7bec06a4ad None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:54.839495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903dbda-ff6a-4931-b7fb-4b7bec06a4ad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:54.839908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903dbda-ff6a-4931-b7fb-4b7bec06a4ad None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:54.841474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:54.847046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf6527-f574-4592-be5b-e2f2840e1390 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:54.847453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf6527-f574-4592-be5b-e2f2840e1390 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:54.847604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf6527-f574-4592-be5b-e2f2840e1390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:54.873473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-74bf6527-f574-4592-be5b-e2f2840e1390 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:54.874953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-74bf6527-f574-4592-be5b-e2f2840e1390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:54.961893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:54.966363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651671-0fca-46cc-b66a-e82992149265 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:54.966890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651671-0fca-46cc-b66a-e82992149265 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:54.967363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651671-0fca-46cc-b66a-e82992149265 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:54.968994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:54.982060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:54.982353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:54.982638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:54.998160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651671-0fca-46cc-b66a-e82992149265 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.005534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:55.006743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:55.084875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:55.145584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 12/25] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:55.179752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.208268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651671-0fca-46cc-b66a-e82992149265 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:55.293367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:55.294246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.294526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.294802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.317684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:25:55.329472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:25:55.330320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:25:55.331066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:25:55.332133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 14/26] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:25:55.339841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.356356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:55.410589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8f262-7e0d-4d92-9eb9-ddc061c0d797 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:55.505187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:55.506022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.506308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.506586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.519964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b727-37f9-4ee7-bc14-6bf85c07ec2e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:55.527281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:55.528823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:25:55.564923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:25:55.565782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:25:55.566574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:25:55.566574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:25:55.566574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:25:55.566574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:25:55.566768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:55.566768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.566768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.566768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.567502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:55.567502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:55.568906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:55.573279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 13/27] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:25:55.578580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 15/28] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:55.578968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.583985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.640858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:55.660714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:55.698000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafa48-0cca-4fd1-aaf5-1a3ca1e4d18d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:55.738597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a05f-dae6-4466-9d60-1ee0020f014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:55.738597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a05f-dae6-4466-9d60-1ee0020f014a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.738597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a05f-dae6-4466-9d60-1ee0020f014a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.739101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a05f-dae6-4466-9d60-1ee0020f014a None admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.744507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a05f-dae6-4466-9d60-1ee0020f014a None admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:55.744507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a05f-dae6-4466-9d60-1ee0020f014a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:55.744507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 16/29] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:25:55 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:55.745689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a0da0-944c-46f5-a5ba-58e3fbc79e17 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.746064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a0da0-944c-46f5-a5ba-58e3fbc79e17 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.746975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a0da0-944c-46f5-a5ba-58e3fbc79e17 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.748061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 17/30] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:55.754398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956f12-7705-4829-a16a-2ecea8dd05a0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.754787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956f12-7705-4829-a16a-2ecea8dd05a0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.755160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3956f12-7705-4829-a16a-2ecea8dd05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.777348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f3956f12-7705-4829-a16a-2ecea8dd05a0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:55.779238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f3956f12-7705-4829-a16a-2ecea8dd05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:55.784690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075208a1-36bc-43fe-8904-d85ff9ea8942 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:55.821900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:55.823370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.823370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.823370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.824242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:55.824666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:55.826218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:55.838840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 14/31] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:55.839797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.861173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 18/32] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:55.863052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe582a0-d77d-498a-99f6-a0aade0a4ac8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:55.863912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe582a0-d77d-498a-99f6-a0aade0a4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:55.864363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe582a0-d77d-498a-99f6-a0aade0a4ac8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:55.866219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 19/33] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:55.867046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe582a0-d77d-498a-99f6-a0aade0a4ac8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:55.951589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:55.956708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:55.966105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b034-163c-43b1-b4cd-761367b6d1c4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:56.006428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0b1d-43f9-45d1-9dca-18c3b85aa40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:56.007243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0b1d-43f9-45d1-9dca-18c3b85aa40f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.007528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0b1d-43f9-45d1-9dca-18c3b85aa40f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.007804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0b1d-43f9-45d1-9dca-18c3b85aa40f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.009001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe582a0-d77d-498a-99f6-a0aade0a4ac8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:56.009412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0b1d-43f9-45d1-9dca-18c3b85aa40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:56.010868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0b1d-43f9-45d1-9dca-18c3b85aa40f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:56.013100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 15/34] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:56.014400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.014687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.014971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.032233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:56.033463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:56.052962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:56.053879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.054809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.055301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.056446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:56.058747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:56.116717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 16/35] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:56.117822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:56.220881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:56.238162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 20/36] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:25:55 2022] POST /identity/v3/projects => generated 301 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:25:56.239015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4705-bd32-44e9-ba2d-ff2d59252daf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:56.239487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:56.279155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:56.280001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.280688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.280982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.282028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:56.283702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:56.370607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982af97c-ba78-4464-a79b-f5431e2834a3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:56.389383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:56.417776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a6a82-e572-4c0e-ada8-775c504cba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:56.421598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a6a82-e572-4c0e-ada8-775c504cba9a None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.421890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a6a82-e572-4c0e-ada8-775c504cba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.422175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a6a82-e572-4c0e-ada8-775c504cba9a None admin] PATH_INFO: `/v3/domains/default/users/0df58371c35d43d69765edab78a9d01a/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.423968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 17/37] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jul 21 05:25:56 2022] POST /identity/v3/roles => generated 225 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:25:56.425202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:56.426937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a6a82-e572-4c0e-ada8-775c504cba9a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0df58371c35d43d69765edab78a9d01a, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:56.436538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a6a82-e572-4c0e-ada8-775c504cba9a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:56.468972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 21/38] 10.222.0.18 () {58 vars in 1361 bytes} [Thu Jul 21 05:25:56 2022] PUT /identity/v3/domains/default/users/0df58371c35d43d69765edab78a9d01a/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:25:56.501221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130a6a-0c2e-4c90-bbb7-1e454b118565 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.501455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130a6a-0c2e-4c90-bbb7-1e454b118565 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.501689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f130a6a-0c2e-4c90-bbb7-1e454b118565 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.503082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 22/39] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:25:56.518379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.518700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.518941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.565801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:56.567403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:56.639921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8c92a-c0fe-439c-8e3e-0e2f4ea3f112 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:56.713093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 23/40] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:25:56.713277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6952963-e542-4b89-899f-30622b51daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:56.713941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6952963-e542-4b89-899f-30622b51daf8 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.714237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6952963-e542-4b89-899f-30622b51daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.714519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6952963-e542-4b89-899f-30622b51daf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.715300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6952963-e542-4b89-899f-30622b51daf8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:56.717903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6952963-e542-4b89-899f-30622b51daf8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:56.740419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:56.748649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 18/41] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jul 21 05:25:56 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:25:56.773570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e80a-ea5c-4fee-b8db-dff37da81fc6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.774630 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e80a-ea5c-4fee-b8db-dff37da81fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.775425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931e80a-ea5c-4fee-b8db-dff37da81fc6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.777922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 19/42] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:25:56.783801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:56.784127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:56.784375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:56.807591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:56.815201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:56.817515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:56.911683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:56.939897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:56.998084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bf582-84d7-4dfe-9348-70f85144c274 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:57.006812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:57.043877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:57.044603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:57.044896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:57.045178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:57.045953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:57.047380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:57.057730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55979be6-7d59-4bc6-8d85-5bbc99c6068f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:57.065274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 24/44] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jul 21 05:25:56 2022] POST /identity/v3/roles => generated 223 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:25:57.095968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf71784-b9f2-43f7-aa9c-479da7ecac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:57.096856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf71784-b9f2-43f7-aa9c-479da7ecac7d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:57.097147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf71784-b9f2-43f7-aa9c-479da7ecac7d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:57.097428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf71784-b9f2-43f7-aa9c-479da7ecac7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:57.098689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf71784-b9f2-43f7-aa9c-479da7ecac7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:57.100196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf71784-b9f2-43f7-aa9c-479da7ecac7d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:57.102159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:57.108680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:57.217395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899be0-bd42-4533-9226-1bb5f396458d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:57.254926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595b5b7-9b6c-488b-a4ea-64655b4e0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:57.255608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595b5b7-9b6c-488b-a4ea-64655b4e0d87 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:57.255891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595b5b7-9b6c-488b-a4ea-64655b4e0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:57.256180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595b5b7-9b6c-488b-a4ea-64655b4e0d87 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:57.256921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595b5b7-9b6c-488b-a4ea-64655b4e0d87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:57.258532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595b5b7-9b6c-488b-a4ea-64655b4e0d87 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:57.285473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:25:57 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:25:58.681869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22cca-5a08-4c03-a24f-560b179875ac None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:58.682375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22cca-5a08-4c03-a24f-560b179875ac None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:58.682375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22cca-5a08-4c03-a24f-560b179875ac None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:58.683710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:25:58.689089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:58.689517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:58.689612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:58.707504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:58.708752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:58.722095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:58.776766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:25:58.799999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22cca-5a08-4c03-a24f-560b179875ac None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:58.804167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:58.905235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22cca-5a08-4c03-a24f-560b179875ac None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:58.939511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:58.940233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:58.940521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:58.940813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:58.953242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:25:58.961930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:25:58.962815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:25:58.963645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:25:58.969336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:59.066168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb689f0-27a2-4159-9b07-3dc6183467a3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:59.101155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:59.101833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.102142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.102425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.103179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:59.103484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:59.104929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:59.113147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 27/50] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:59.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:59.184206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:59.225175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33e3b-4209-49a8-b890-0ffd4525ece2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:59.259808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b5a86-bf97-4aa6-96d1-629ef5cc2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:59.260739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b5a86-bf97-4aa6-96d1-629ef5cc2d7d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.261028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b5a86-bf97-4aa6-96d1-629ef5cc2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.261306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b5a86-bf97-4aa6-96d1-629ef5cc2d7d None admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.262811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b5a86-bf97-4aa6-96d1-629ef5cc2d7d None admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:59.264293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b5a86-bf97-4aa6-96d1-629ef5cc2d7d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:59.265992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:25:59 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:59.271717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:59.285278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:59.299295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c312a-dba8-4788-b76c-23ecde33e46c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.299591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c312a-dba8-4788-b76c-23ecde33e46c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.299866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c312a-dba8-4788-b76c-23ecde33e46c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.301274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 25/52] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:25:59.306180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.306445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.306761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.323878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:25:59.325103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:25:59.376094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2523-0a5e-499e-b2fb-536bf7c416d9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:59.390912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 26/53] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:25:59.410347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:59.411160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.411450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.411775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.413028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:59.414505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:59.415312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:59.416231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:59.425378 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:59.513133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:59.538959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0305b2-e7ec-4a8d-89b4-e83489b0e2d1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:59.577846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:59.578522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.578809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.579091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.579941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.domain.id=default, user.id=0df58371c35d43d69765edab78a9d01a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:25:59.580260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:59.581789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:59.588447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1322 bytes} [Thu Jul 21 05:25:59 2022] GET /identity/v3/role_assignments?user.id=0df58371c35d43d69765edab78a9d01a&scope.domain.id=default&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:25:59.614406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:59.656738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc541f-b438-4a9f-9a38-5a63d84f051b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:59.694044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981b29f-6cf3-4759-98b8-70940b8a5e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:59.695246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b29f-6cf3-4759-98b8-70940b8a5e8c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.695522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b29f-6cf3-4759-98b8-70940b8a5e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.695893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b29f-6cf3-4759-98b8-70940b8a5e8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.697126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981b29f-6cf3-4759-98b8-70940b8a5e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:59.698596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981b29f-6cf3-4759-98b8-70940b8a5e8c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:59.700273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:25:59.706302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:25:59.809152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c6af4-0a6e-48ce-8ded-bbf822d47a5d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:25:59.844713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3cf97-54c2-4bad-8ff8-66417e7201eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:25:59.845387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3cf97-54c2-4bad-8ff8-66417e7201eb None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:25:59.845674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3cf97-54c2-4bad-8ff8-66417e7201eb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:25:59.845952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3cf97-54c2-4bad-8ff8-66417e7201eb None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:25:59.846680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3cf97-54c2-4bad-8ff8-66417e7201eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:25:59.848152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3cf97-54c2-4bad-8ff8-66417e7201eb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:25:59.862727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:25:59.884986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jul 21 05:25:59 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:01.897652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968fd72-1255-471c-9bd0-f735aa3767e6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:01.898468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968fd72-1255-471c-9bd0-f735aa3767e6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:01.898604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968fd72-1255-471c-9bd0-f735aa3767e6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:01.900820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:01.906154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:01.906564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:01.906684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:01.925247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:01.926454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:01.996547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:02.020748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968fd72-1255-471c-9bd0-f735aa3767e6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:02.130453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968fd72-1255-471c-9bd0-f735aa3767e6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:02.159277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:02.165230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d6f4-354c-43a4-8b7f-f00e9b07f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:02.166027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d6f4-354c-43a4-8b7f-f00e9b07f791 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:02.166347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d6f4-354c-43a4-8b7f-f00e9b07f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:02.166580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d6f4-354c-43a4-8b7f-f00e9b07f791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:02.167791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998d6f4-354c-43a4-8b7f-f00e9b07f791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:02.169303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998d6f4-354c-43a4-8b7f-f00e9b07f791 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:02.170914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:02.176581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:02.276069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e349308-9da7-416a-8824-0174d91a0bb1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:02.299497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:02.312443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57649c4-d4c2-4a41-b1b5-7ec9d81d0575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:02.313142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57649c4-d4c2-4a41-b1b5-7ec9d81d0575 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:02.313428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57649c4-d4c2-4a41-b1b5-7ec9d81d0575 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:02.313706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57649c4-d4c2-4a41-b1b5-7ec9d81d0575 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:02.314420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57649c4-d4c2-4a41-b1b5-7ec9d81d0575 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:02.315887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57649c4-d4c2-4a41-b1b5-7ec9d81d0575 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:02.343055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:02 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:05.378048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1def-f5f3-429f-81c9-89d312637de0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.378599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1def-f5f3-429f-81c9-89d312637de0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.378599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1def-f5f3-429f-81c9-89d312637de0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.379963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:26:05.385854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aeade-8079-40e7-bd64-3ffc1d7051f6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.386603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aeade-8079-40e7-bd64-3ffc1d7051f6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.387044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aeade-8079-40e7-bd64-3ffc1d7051f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.413895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-587aeade-8079-40e7-bd64-3ffc1d7051f6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:05.415511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-587aeade-8079-40e7-bd64-3ffc1d7051f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:05.511150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 33/63] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:05.559121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f1def-f5f3-429f-81c9-89d312637de0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:05.716285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f1def-f5f3-429f-81c9-89d312637de0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:05.734103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5100c-beb3-4351-b152-47abc642edb5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.734752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5100c-beb3-4351-b152-47abc642edb5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.735222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5100c-beb3-4351-b152-47abc642edb5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.736929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 34/64] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:26:05.742369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac65a-5af6-41fb-b2ba-72456b287c99 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.743112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac65a-5af6-41fb-b2ba-72456b287c99 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.743582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac65a-5af6-41fb-b2ba-72456b287c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.771325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b3bac65a-5af6-41fb-b2ba-72456b287c99 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:05.772565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b3bac65a-5af6-41fb-b2ba-72456b287c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:05.777476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:05.778299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.778582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.778858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.798766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:05.812340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:05.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:05.813957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:05.817669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 31/65] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:05.820859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:05.880502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 35/66] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:05.880502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c1273-a56f-46f7-bcc3-d05f94887452 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.880502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c1273-a56f-46f7-bcc3-d05f94887452 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.880502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c1273-a56f-46f7-bcc3-d05f94887452 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.880502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 36/67] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:05.883476 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:05.883773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:05.884057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:05.903183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:05.904379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:05.911777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:05.948721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:05.967174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391085-00e9-46fa-b4d0-4b3828d1399b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:05.995561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 37/68] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:05.997254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.014131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.014875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.015164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.015445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.016282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:06.016668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.018370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b8fc-54a8-425e-9e58-b4a27f858a5d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.038715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 32/69] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:06.040440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4947aa-6089-40c1-98f0-4834ed6a77fe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.040911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4947aa-6089-40c1-98f0-4834ed6a77fe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.041326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4947aa-6089-40c1-98f0-4834ed6a77fe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.042772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 33/70] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:06.043787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4947aa-6089-40c1-98f0-4834ed6a77fe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.105370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0fd71-0d95-48de-9548-03dcb0f352c6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.139571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.140386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.140699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.140979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.143368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4947aa-6089-40c1-98f0-4834ed6a77fe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.151207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:06.158854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:06.159803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:06.160592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 38/71] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:06.161401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.168498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.184284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568176cb-2548-4d91-8cba-56b94dd32907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.185117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568176cb-2548-4d91-8cba-56b94dd32907 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.185394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568176cb-2548-4d91-8cba-56b94dd32907 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.185662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568176cb-2548-4d91-8cba-56b94dd32907 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.192338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.196613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568176cb-2548-4d91-8cba-56b94dd32907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-568176cb-2548-4d91-8cba-56b94dd32907 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:06.205067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:06.205950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:06.206865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 34/72] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:06.207718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee8d2-1f78-4a23-b820-b9444fc955c9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.207930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee8d2-1f78-4a23-b820-b9444fc955c9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.208212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee8d2-1f78-4a23-b820-b9444fc955c9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.213474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 35/73] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:06.213474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.213474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.213474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.227924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:06.229076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:06.269208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c969a-f778-429b-9261-998bd2da18b2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.294200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 36/74] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:06.295036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.312239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.313179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.313751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.314059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.315521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.317147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.318872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 39/75] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:06.319982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.412533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acfa8f-3933-4252-8d7f-c5d1ad486f50 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.418848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.423315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ef231-6825-416b-be5b-0304a9433a17 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.425700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.451294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.451982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.452262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.452563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.453323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:06.453638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.455046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e48383-3b81-4d3a-8cc0-f73b2679904f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.458459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.459138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.459423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.459699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.460453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:06.460789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.462208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.463110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 37/76] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:06.465755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.466053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.466339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.470224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 40/77] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:06.470224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.484077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:06.485249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:06.549566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 38/78] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:06.550397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.568560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a9d9a-db61-46eb-8eb0-09a769f63b08 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.602047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.602891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.603180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.603462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.613461 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:06.621240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:06.622053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:06.622886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 41/79] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:06.625287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.646750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.664631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9d3f-750b-4025-b814-2f715cadc04b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.666409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.701545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.702219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.702503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.702782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.728166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769068c-edd5-4e70-812d-074fd882f0dc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.760964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.761776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.762056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.762320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.770979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.772493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.775236 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.776744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.778391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 42/80] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:06.781325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.857350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.871634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 39/81] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:06.872499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.874700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:06.883240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176d3c8-9f6b-4c05-ab98-3042eddb22bb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:06.916817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:06.917681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:06.917946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:06.918223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:06.919397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:06.920873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:06.926949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 43/82] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:06.926949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:06.971136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40c504-c3c6-492b-96cb-f8e1165e3a66 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.005655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.006441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.006724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.007002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.008205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.009793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.011495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 40/83] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.012188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.018277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a5e1d-0c2e-4baa-8e13-5ea31c091961 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.052202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.052912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.053188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.053465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.054216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:07.054542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.055975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.063980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 44/84] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.064788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.076777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.081059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.111775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a3284-38bb-430c-833c-e1321459f34a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.145763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.146432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.146719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.147000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.162167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c972a0-bc24-4de5-98ea-3a15955ab4e2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.197864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.198728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.199009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.199287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.200552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.202026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.203887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 45/85] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.204587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.218716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.220172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.282197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.287169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.305397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0398d78-e98b-4824-acd0-69efc1117ee8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.321658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:07.322467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.340341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.341037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.341332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.341609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.406841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.408340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.423160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fe52-47f1-4e8c-b40e-8e4677195076 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.455980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.456684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.456966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.457248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.457965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.459424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.483332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.485131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 42/87] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:07 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:07.486017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.508850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 46/88] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:07.513767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.530929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.623666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a844e5-136f-4037-b969-a926e652d097 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.627029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa2f8-d003-4108-bad4-a239f7d22cdd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.663586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.664507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.664895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.665166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.666383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.667012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.667676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.667849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.667945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.668221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.669086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=0df58371c35d43d69765edab78a9d01a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:07.669403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.669571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 43/89] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.670289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.670849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.677537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 47/90] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/role_assignments?user.id=0df58371c35d43d69765edab78a9d01a&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.678092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.736799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.803607 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:07.819275 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511832f5-fd66-4e8c-a159-c87a896c100c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.826481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fba035-ef64-4e52-af0e-eec1d4d7b380 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:07.866907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.868251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.868703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.869118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.871684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.873222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.875038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 44/91] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.875764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.895491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:07.896857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:07.897337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:07.897920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:07.900650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:07.902421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:07.904459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 48/92] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:07.905476 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:07.990159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42bb0-d961-48ff-b29f-94225dddf2d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:08.035058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0a1d-d28e-47b0-acc1-0010f2cb572c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:08.039476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:08.040219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:08.040532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:08.040816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:08.046481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:08.083177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:08.084208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:08.084728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:08.085225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:08.086590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=900cdf48c6ec493f841a7267e181fefd) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:08.087103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:08.088814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:08.095468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 49/93] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/role_assignments?user.id=900cdf48c6ec493f841a7267e181fefd&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:08.100795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:08.125187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:08.197501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:08.198998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:08.245427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481238f-8a5b-4539-bccf-800621d225ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:08.281646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:08.282724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:08.283222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:08.283691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:08.284873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] RBAC: Adding query filter params (role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=900cdf48c6ec493f841a7267e181fefd) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:08.285413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:08.287169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:08.293892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 50/94] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:08 2022] GET /identity/v3/role_assignments?user.id=900cdf48c6ec493f841a7267e181fefd&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:08.375446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 45/95] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:08.381550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:08.436892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:08.511559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9297d-fd77-4597-9c7d-8f85f8a635f5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:08.548696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139da29-e429-486f-ab7d-09d6c0dbc0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:08.549594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139da29-e429-486f-ab7d-09d6c0dbc0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:08.549880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139da29-e429-486f-ab7d-09d6c0dbc0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:08.550156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139da29-e429-486f-ab7d-09d6c0dbc0b5 None admin] PATH_INFO: `/v3/projects/bbad5c44fc9d425c8602006bb1434dd7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:08.551388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139da29-e429-486f-ab7d-09d6c0dbc0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=bbad5c44fc9d425c8602006bb1434dd7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:08.552911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139da29-e429-486f-ab7d-09d6c0dbc0b5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:08.554958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 51/96] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:08 2022] GET /identity/v3/projects/bbad5c44fc9d425c8602006bb1434dd7 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:08.560960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:08.641539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:08.696980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796ca12-e839-4d7c-b853-b8ee07ca8a7c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:08.742476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:08.743191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:08.743481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:08.743811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:08.744682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=bbad5c44fc9d425c8602006bb1434dd7, user.id=900cdf48c6ec493f841a7267e181fefd) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:08.744996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:08.746462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c6b63-e4c1-4594-ae8e-9e7ca90c5122 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:08.759439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 46/97] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:08 2022] GET /identity/v3/role_assignments?user.id=900cdf48c6ec493f841a7267e181fefd&scope.project.id=bbad5c44fc9d425c8602006bb1434dd7&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:10.187395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174e88-a2c4-41de-8311-d13bb0dc8f3d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.187910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174e88-a2c4-41de-8311-d13bb0dc8f3d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.187981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174e88-a2c4-41de-8311-d13bb0dc8f3d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.189611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 52/98] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:10.195439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.195964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.196148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.216573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:10.217785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:10.298286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:10.332859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174e88-a2c4-41de-8311-d13bb0dc8f3d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:10.470181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174e88-a2c4-41de-8311-d13bb0dc8f3d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:10.472531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:10.514139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260045d-e15a-409b-980a-6547141cccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:10.515007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260045d-e15a-409b-980a-6547141cccb3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.515291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260045d-e15a-409b-980a-6547141cccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.515568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260045d-e15a-409b-980a-6547141cccb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.528616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260045d-e15a-409b-980a-6547141cccb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2260045d-e15a-409b-980a-6547141cccb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:10.536206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:10.537106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:10.537855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 53/100] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:10.543729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:10.559662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573ded3-7bb5-4ef8-b9fa-8937c9bea8f1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.559951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573ded3-7bb5-4ef8-b9fa-8937c9bea8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.560233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573ded3-7bb5-4ef8-b9fa-8937c9bea8f1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.561645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 54/101] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:10.566709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562e55-b1de-496f-81c5-f027be2e2993 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.567148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562e55-b1de-496f-81c5-f027be2e2993 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.567556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562e55-b1de-496f-81c5-f027be2e2993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.597506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6c562e55-b1de-496f-81c5-f027be2e2993 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:10.598909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6c562e55-b1de-496f-81c5-f027be2e2993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:10.638790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:10.719935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce996f9-1ee6-48d1-ba7a-a90b3d42042f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:10.724753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 55/102] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:10.726161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a02e-e259-44cc-91fa-15ea42409b91 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.726445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a02e-e259-44cc-91fa-15ea42409b91 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.726719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a02e-e259-44cc-91fa-15ea42409b91 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.728111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 56/103] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:10.739076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.739418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.739699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.777817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:10.778998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:10.803987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:10.804761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:10.805042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:10.811528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:10.812354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:10.812696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:10.814130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:10.825657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 48/104] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:10.826844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:10.925765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 57/105] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:10.927077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:10.976788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:10.987207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da905-1b23-4c9a-a439-b47816300563 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.012574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.028777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.030318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.030800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.031267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.033278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.035008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.036917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 49/106] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:11.038185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.126377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc40e8-f609-4a63-aab6-152ea25bba11 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.174937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.176211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.176714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.177169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.178586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.180259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.182173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 58/107] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:10 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:11.183085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.201963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8454bb-b552-422a-b4f1-fcef74195546 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.248844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a24d-13fa-460d-8803-a69a6b55622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.249915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a24d-13fa-460d-8803-a69a6b55622c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.250270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a24d-13fa-460d-8803-a69a6b55622c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.250604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a24d-13fa-460d-8803-a69a6b55622c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.263606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a24d-13fa-460d-8803-a69a6b55622c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-83d1a24d-13fa-460d-8803-a69a6b55622c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:11.273683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:11.274650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:11.275407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:11.275977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 50/108] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:11.281028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbafc44-f47b-4267-83e5-097a87cd7285 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.281028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbafc44-f47b-4267-83e5-097a87cd7285 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.281028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbafc44-f47b-4267-83e5-097a87cd7285 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.281028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 51/109] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:11.281028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbafc44-f47b-4267-83e5-097a87cd7285 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.287974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.300261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46faa6-7405-41f9-9116-fd113b7df078 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.336998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.337682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.337963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.338231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.339466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.340551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.352345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.373754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 59/110] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:26:11 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:11.374910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.423577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbafc44-f47b-4267-83e5-097a87cd7285 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.463272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f000-ffae-4497-87a4-5e6095b60bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.464337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f000-ffae-4497-87a4-5e6095b60bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.464724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f000-ffae-4497-87a4-5e6095b60bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.465089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f000-ffae-4497-87a4-5e6095b60bb0 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.466581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f000-ffae-4497-87a4-5e6095b60bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.468146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f000-ffae-4497-87a4-5e6095b60bb0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.470264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 52/111] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:11.471480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.471848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.472196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.495302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:11.496907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:11.499002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939a73-502c-4471-8197-3e938f828273 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.535456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.536161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.536447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.536753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.537549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:11.537856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.539308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7d2e4-2cbc-4ba4-bda8-bc72c2cf315c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.548949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 60/112] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:11.550451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558dd1c-2d16-420b-9249-33d0b9b75d8b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.550829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558dd1c-2d16-420b-9249-33d0b9b75d8b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.551112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558dd1c-2d16-420b-9249-33d0b9b75d8b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.552792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 61/113] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:11.553523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558dd1c-2d16-420b-9249-33d0b9b75d8b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.570309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.584527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 53/114] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:11.584777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.647553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.699922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558dd1c-2d16-420b-9249-33d0b9b75d8b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.706129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc4d5-14e5-4c2e-86b6-3588fcc1a654 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.741369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c64dff-dc34-4ee2-9f5a-e42906e3dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.742263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c64dff-dc34-4ee2-9f5a-e42906e3dbab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.742545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c64dff-dc34-4ee2-9f5a-e42906e3dbab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.742918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c64dff-dc34-4ee2-9f5a-e42906e3dbab None admin] PATH_INFO: `/v3/users/cd6c89a96efc4a6095d8c22b9fe0a5b5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.743046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.743935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.744218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.744523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/0df58371c35d43d69765edab78a9d01a/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.747701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a0066d332c04a8a9b259f8e09b1012e, user_id=0df58371c35d43d69765edab78a9d01a, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.750909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.762265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c64dff-dc34-4ee2-9f5a-e42906e3dbab None admin] RBAC: Authorizing `identity:get_user(user_id=cd6c89a96efc4a6095d8c22b9fe0a5b5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:11.763808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c64dff-dc34-4ee2-9f5a-e42906e3dbab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:11.765950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 54/115] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/users/cd6c89a96efc4a6095d8c22b9fe0a5b5 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:11.767620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 62/116] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:11 2022] PUT /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/0df58371c35d43d69765edab78a9d01a/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:11.768526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.771964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.772251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.772564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.791721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:11.793086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:11.845229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.867606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 55/117] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:11.876992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:11.884186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5941f19-5067-4af0-a180-0c0ba7a00f82 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:11.920901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:11.948091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:11.948967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:11.949252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:11.949530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:11.961262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:11.970121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:11.971149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:11.971922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 63/118] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:11.972600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.006797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5b588-5508-4d0d-a903-08d0135b0eb1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.050167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115a4e3-1936-4964-94fb-0923f2c8102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.050873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a4e3-1936-4964-94fb-0923f2c8102c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.051154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a4e3-1936-4964-94fb-0923f2c8102c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.051428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a4e3-1936-4964-94fb-0923f2c8102c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.095478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b16120-b310-4f7b-81e6-1766b31f3c38 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.129751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.152778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115a4e3-1936-4964-94fb-0923f2c8102c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.154499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115a4e3-1936-4964-94fb-0923f2c8102c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.154703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.155527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.155909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.156192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.171439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:12.181924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:12.182950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:12.183885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 64/119] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:12.184687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.196763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.273498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 56/120] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:12.279243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4375-13e4-4209-90ff-29cb363b07cc None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.279581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4375-13e4-4209-90ff-29cb363b07cc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.279879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4375-13e4-4209-90ff-29cb363b07cc None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.281386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 57/121] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:12.282134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4375-13e4-4209-90ff-29cb363b07cc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.308577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7c29-6fab-445e-8e98-b193580c0436 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.346269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.347339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.347820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.348282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.349561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:12.350085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.352571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.362127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 65/122] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:12.363160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.401321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4375-13e4-4209-90ff-29cb363b07cc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.415570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.438082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.443410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.444846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.445448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.445846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.446886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:12.447196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.448773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a3c82-c6c3-465d-8695-6e50b6022ea3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.462831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 58/123] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:12.464426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.464736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.465013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.476268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89a34-7f17-4f68-9795-f74d3c778082 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.482007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:12.483194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:12.511491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.512435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.512783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.513159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.514346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.515916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.517704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 66/124] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:12.518469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.571286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 59/125] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:12.573418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.650390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592f21-c744-4d01-9c65-edc057531056 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.670192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.693921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.695215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.696116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.696397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.698043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.700361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.702742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 67/126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:12.703676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.717560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd76010-98c4-41b6-9c60-4649bcec5e7c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.750452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.765281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.767101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.767530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.768214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.769887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.771910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.774338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 60/127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:12.779225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.829609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37a42e-efd4-47a0-bc4c-711949d1ed59 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.865721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.866775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.867254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.867725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.868928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] RBAC: Adding query filter params (role.id=a51e4cf245274a1c8bf99cf4b534aa86, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=cd6c89a96efc4a6095d8c22b9fe0a5b5) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:12.869549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:12.871209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:12.877404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 68/128] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/role_assignments?user.id=cd6c89a96efc4a6095d8c22b9fe0a5b5&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=a51e4cf245274a1c8bf99cf4b534aa86 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:12.877937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90943a2-57ff-409c-877a-f102d4b6fe9b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:12.878695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.915979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:12.916828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:12.917108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:12.917378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:12.928317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:12.934829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:12.937132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:12.937987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:12.938754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 61/129] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:12.939475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:12.999276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:13.001383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18258369-a35f-4484-b5d8-3f458f474a9d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.039295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.040709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.041186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.041631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.043188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.045026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.047163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 69/130] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:13.048132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:13.057977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae47d8b-2e1b-4b33-bf55-72f04ab7acfc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.100811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.100811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.100811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.100811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.101199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.101199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.101327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 62/131] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:12 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:13.102116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:13.220506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941931fa-a337-4260-904c-4d0a250cb9c0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.231158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce73ff-4e53-495a-a5b8-66a870314025 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.237111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:13.249197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.253807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.253807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.253807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/900cdf48c6ec493f841a7267e181fefd/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.253807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a0066d332c04a8a9b259f8e09b1012e, user_id=900cdf48c6ec493f841a7267e181fefd, role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.254321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.260615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:13.287912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.287912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.287912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.287912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.288316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:13.288316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.288316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.288818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:13 2022] PUT /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/900cdf48c6ec493f841a7267e181fefd/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:13.291075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:13.298426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 70/133] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:13.303986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:13.507808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ab090-1492-4673-a560-68453173bd94 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.530769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df0cbb-5698-4e02-abda-2f12e9eab467 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.553451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.554418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.554707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.554987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/900cdf48c6ec493f841a7267e181fefd/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.557322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a0066d332c04a8a9b259f8e09b1012e, user_id=900cdf48c6ec493f841a7267e181fefd, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.558910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.567879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.569180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.570035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.570965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.572635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.574420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.575327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:13 2022] PUT /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/900cdf48c6ec493f841a7267e181fefd/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:13.576719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 71/135] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:13 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:13.586649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:13.646818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:13.715523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded94e49-9885-401d-96bd-e3438a8e97c5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.753565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae3285-dfb3-4502-ac15-5e7ca275820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.754501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae3285-dfb3-4502-ac15-5e7ca275820e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.754790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae3285-dfb3-4502-ac15-5e7ca275820e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.755109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae3285-dfb3-4502-ac15-5e7ca275820e None admin] PATH_INFO: `/v3/projects/bbad5c44fc9d425c8602006bb1434dd7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.756311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae3285-dfb3-4502-ac15-5e7ca275820e None admin] RBAC: Authorizing `identity:get_project(project_id=bbad5c44fc9d425c8602006bb1434dd7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.757879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae3285-dfb3-4502-ac15-5e7ca275820e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.760078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 65/136] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:13 2022] GET /identity/v3/projects/bbad5c44fc9d425c8602006bb1434dd7 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:13.766118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:13.821376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:13.886428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a613f8-c1b4-4c82-828d-c5e70631e5c8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:13.925311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:13.926280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.926569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.926844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] PATH_INFO: `/v3/projects/bbad5c44fc9d425c8602006bb1434dd7/users/900cdf48c6ec493f841a7267e181fefd/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.928848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbad5c44fc9d425c8602006bb1434dd7, user_id=900cdf48c6ec493f841a7267e181fefd, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:13.931581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7c69a-a775-41f6-a3cb-7ee868dff45e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.931869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7c69a-a775-41f6-a3cb-7ee868dff45e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.932147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7c69a-a775-41f6-a3cb-7ee868dff45e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.933621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 66/137] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:26:13.934200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:13.938748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:13.939035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:13.939316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:13.958609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:13.959868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:13.970424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 72/138] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:13 2022] PUT /identity/v3/projects/bbad5c44fc9d425c8602006bb1434dd7/users/900cdf48c6ec493f841a7267e181fefd/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:14.039526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:14.075555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:14.199583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231dae9-74eb-49e5-8b2a-964a9f712e47 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:14.208035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:14.248548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c999830-aaec-48d0-a54a-bb6ecee8948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:14.249348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c999830-aaec-48d0-a54a-bb6ecee8948c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:14.249585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c999830-aaec-48d0-a54a-bb6ecee8948c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:14.249860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c999830-aaec-48d0-a54a-bb6ecee8948c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:14.251150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c999830-aaec-48d0-a54a-bb6ecee8948c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:14.252686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c999830-aaec-48d0-a54a-bb6ecee8948c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:14.254430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 73/140] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:14.260380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:14.307120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:14.352413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a27be-67c2-42ed-bece-df00a80aae00 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:14.352753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a27be-67c2-42ed-bece-df00a80aae00 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:14.353010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a27be-67c2-42ed-bece-df00a80aae00 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:14.354613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 74/141] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:14.360634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:14.360940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:14.361201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:14.381681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:14.383172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:14.400338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9ad7-2e61-461e-8604-e1169d80b469 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:14.457939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 75/142] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:14.484734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:14.494240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:14.494956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:14.495235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:14.495514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:14.496248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:14.497769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:14.543147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 68/143] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:14 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:14.636231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9ff19-9d7a-430e-847e-9f4d757738a1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:14.641827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:14.692889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:14.693725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:14.694005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:14.694279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:14.706994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:14.715139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:14.716057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:14.716846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 76/144] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:14.726909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:14.837257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:14.845703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264d80e-5d5b-4f4c-aaf7-348484b6c4e7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:14.887720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:14.888503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:14.888784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:14.889067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:14.889888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:14.890208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:14.891616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:14.904443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 69/145] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:14.910132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:15.056969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128ba3-582e-434d-bb8a-1c1085463515 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:15.091551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:15.092359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:15.092674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:15.092956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] PATH_INFO: `/v3/users/0df58371c35d43d69765edab78a9d01a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:15.094156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] RBAC: Authorizing `identity:get_user(user_id=0df58371c35d43d69765edab78a9d01a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:15.095625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:15.097469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 77/146] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:14 2022] GET /identity/v3/users/0df58371c35d43d69765edab78a9d01a => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:15.103307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:15.225013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e7805-0dac-4502-87b9-099d681200e9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:15.266555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:15.267238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:15.267526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:15.267806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:15.305644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:15.362795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:15.364203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:15.487726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 70/147] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:15.493488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:15.570348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:15.624724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83cb03-1e18-4c0c-8f27-575654bca73b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:15.658814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144dff6-3d5f-485f-8fe3-24b64749e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:15.659698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dff6-3d5f-485f-8fe3-24b64749e047 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:15.659983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dff6-3d5f-485f-8fe3-24b64749e047 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:15.660322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144dff6-3d5f-485f-8fe3-24b64749e047 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:15.661547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144dff6-3d5f-485f-8fe3-24b64749e047 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:15.663028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144dff6-3d5f-485f-8fe3-24b64749e047 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:15.665165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 78/148] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:15 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:15.670787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:15.746778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:15.804883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143fc7-83db-4cf4-b482-967fb542393d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:15.846587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:15.847270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:15.847559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:15.847835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:15.848733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=0df58371c35d43d69765edab78a9d01a) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:15.849047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:15.850518 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515571fe-426d-4860-a9a9-c25d373289e0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:15.857119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 71/149] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:15 2022] GET /identity/v3/role_assignments?user.id=0df58371c35d43d69765edab78a9d01a&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:16.035088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f732-2dce-49a0-88fb-9f109c2c7725 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.035453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f732-2dce-49a0-88fb-9f109c2c7725 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.035621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f732-2dce-49a0-88fb-9f109c2c7725 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.037074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 79/150] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:16.042970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.043271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.043537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.065024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:16.066244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:16.146234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 72/151] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:16.186053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f732-2dce-49a0-88fb-9f109c2c7725 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:16.304701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:16.311913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f732-2dce-49a0-88fb-9f109c2c7725 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:16.354549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:16.355373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.355656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.355939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.369750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:16.377574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:16.378429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:16.379191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 80/152] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:16.384966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:16.454904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:16.513931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041f15-697f-483a-aa68-406d1888c0ee None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:16.552930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:16.553632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.553943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.554199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.555014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:16.555264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:16.556762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:16.568833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 73/153] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:16.572041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:16.711357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34282b40-db4b-4307-9c38-a6e417d47b1b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:16.745731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b4c2-b370-499f-8d65-9b83919595e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:16.746978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b4c2-b370-499f-8d65-9b83919595e7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.747468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b4c2-b370-499f-8d65-9b83919595e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.747924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b4c2-b370-499f-8d65-9b83919595e7 None admin] PATH_INFO: `/v3/users/cd6c89a96efc4a6095d8c22b9fe0a5b5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.749362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83b4c2-b370-499f-8d65-9b83919595e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cd6c89a96efc4a6095d8c22b9fe0a5b5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:16.751037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83b4c2-b370-499f-8d65-9b83919595e7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:16.752925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 81/154] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:16 2022] GET /identity/v3/users/cd6c89a96efc4a6095d8c22b9fe0a5b5 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:16.758834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:16.890213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d3e6-cd10-4b93-bf8c-984886542023 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.890812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d3e6-cd10-4b93-bf8c-984886542023 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.891273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d3e6-cd10-4b93-bf8c-984886542023 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.892875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 82/155] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:16.898475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.898624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5e63a-5209-4a74-8ca6-411a2a3cec7e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:16.899144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.899625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.924851 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:16.933462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:16.937672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:16.939164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:16.940032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:16.940317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:16.940620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:16.941829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:16.943296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:16.957455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 74/156] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:16 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:16.964206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:16.988858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:17.016570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 83/157] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:17.056842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.108101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8579-31e5-486d-9b09-746b4d3418b2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:17.165358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f8904-f87e-497b-9880-2474aceb8219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:17.166203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8904-f87e-497b-9880-2474aceb8219 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.166485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8904-f87e-497b-9880-2474aceb8219 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.166763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8904-f87e-497b-9880-2474aceb8219 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/cd6c89a96efc4a6095d8c22b9fe0a5b5/roles/a51e4cf245274a1c8bf99cf4b534aa86` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.168861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8904-f87e-497b-9880-2474aceb8219 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a0066d332c04a8a9b259f8e09b1012e, user_id=cd6c89a96efc4a6095d8c22b9fe0a5b5, role_id=a51e4cf245274a1c8bf99cf4b534aa86)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:17.170325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f8904-f87e-497b-9880-2474aceb8219 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:17.173131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c1747-5ba5-4f31-b51a-da116bfbfa1f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:17.198714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 75/158] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:16 2022] PUT /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/users/cd6c89a96efc4a6095d8c22b9fe0a5b5/roles/a51e4cf245274a1c8bf99cf4b534aa86 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:26:17.200051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc86c-4071-44a7-956c-1879ab821cbb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.200517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc86c-4071-44a7-956c-1879ab821cbb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.200954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc86c-4071-44a7-956c-1879ab821cbb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.202397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 76/159] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:17.209450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.209990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.210423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.217289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:17.218497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.218941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.219396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.229373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:17.230642 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:17.236924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:17.252304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:17.253509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:17.254321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:17.256435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 84/160] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:17.262728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.268072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:17.287607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:17.322685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 77/161] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:17.366406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.380844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77c5f-00b1-4388-8507-8932d20723a8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:17.432498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:17.432498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.432498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.432498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.432911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:17.432911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:17.433368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:17.447839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 85/162] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:17.453675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.533598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600ff64-f369-4e0f-9d12-28b015534349 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:17.556818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:17.582213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afeddc-9ba0-487e-b0da-4ebfa47f97c3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:17.597337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:17.598206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.598484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.598755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.621058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:17.633178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:17.634436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:17.635301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 78/163] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:17.645509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.667939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:17.669105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.669523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.669928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.671305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:17.672947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:17.674744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 86/164] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:17.681468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.685298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:17.778159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc1581-03a9-421b-a8e7-1b1ff4044e2c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:17.833251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:17.833944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:17.834226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:17.834497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:17.835255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:17.835560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:17.837071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:17.845983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 79/165] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:17.851449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:17.958301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b006a-1f24-468f-a83e-e2522e628c1b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:18.014188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff88384-1e2f-45dd-b6a3-2d8aba6d4b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:18.015114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff88384-1e2f-45dd-b6a3-2d8aba6d4b9e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.015538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff88384-1e2f-45dd-b6a3-2d8aba6d4b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.015977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff88384-1e2f-45dd-b6a3-2d8aba6d4b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.024347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:18.043917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac083f4-880b-4b66-9e47-4827712d8745 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:18.048845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:18.096789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff88384-1e2f-45dd-b6a3-2d8aba6d4b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:18.098581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff88384-1e2f-45dd-b6a3-2d8aba6d4b9e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:18.144332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd4744-aeb2-478f-b198-a4dae565f201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:18.145277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4744-aeb2-478f-b198-a4dae565f201 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.145547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4744-aeb2-478f-b198-a4dae565f201 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.145814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4744-aeb2-478f-b198-a4dae565f201 None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.147014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd4744-aeb2-478f-b198-a4dae565f201 None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:18.148487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd4744-aeb2-478f-b198-a4dae565f201 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:18.151212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 80/166] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:18.154398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9edea-b9ce-44db-828f-ca8219034f28 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.154690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9edea-b9ce-44db-828f-ca8219034f28 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.157225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9edea-b9ce-44db-828f-ca8219034f28 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.158757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 81/167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:18.160696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9edea-b9ce-44db-828f-ca8219034f28 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:18.203413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 87/168] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:18.204859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.205119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.205514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.223068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:18.224181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:18.283929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:18.347060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 88/169] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:18.353626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:18.390415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9edea-b9ce-44db-828f-ca8219034f28 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:18.497796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:18.498383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.498667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.498943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.545325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:18.622970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:18.624974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:18.638377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d110b-1a18-4956-9abc-7b1d401bd81f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:18.733742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:18.734634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.734921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.735200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.742288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:18.742738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:18.744779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 89/170] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:18 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:18.748562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:18.803084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 82/171] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:18.803959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:18.851433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:18.893701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:18.935523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d0e9-0fb2-49ce-9ae9-c9c114344f4e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:18.953900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dcda1-cc40-4149-9d6a-3c5e9a95a394 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:18.972841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:18.973491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:18.973775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:18.974035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:18.978497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] RBAC: Adding query filter params (role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=900cdf48c6ec493f841a7267e181fefd) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:18.978497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:18.978497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:18.983350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 83/172] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:18 2022] GET /identity/v3/role_assignments?user.id=900cdf48c6ec493f841a7267e181fefd&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:18.984232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.018827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab7464-e80f-4e1d-abaa-8667bfef11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.020493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7464-e80f-4e1d-abaa-8667bfef11cd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.020985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7464-e80f-4e1d-abaa-8667bfef11cd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.021549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7464-e80f-4e1d-abaa-8667bfef11cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.033738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab7464-e80f-4e1d-abaa-8667bfef11cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-aeab7464-e80f-4e1d-abaa-8667bfef11cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:19.042463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:19.043451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:19.044228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:19.047305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 90/173] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:19.053177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b55e2-af2c-4667-b39a-cb2935e70577 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.053890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b55e2-af2c-4667-b39a-cb2935e70577 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.054363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b55e2-af2c-4667-b39a-cb2935e70577 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.056203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 91/174] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:19.058648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b55e2-af2c-4667-b39a-cb2935e70577 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.134795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb947-1cf0-4017-863d-5a4f643076c9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:19.174955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:19.188003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b55e2-af2c-4667-b39a-cb2935e70577 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:19.197166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:19.201187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a60eb-4319-4a47-87b6-a6d77c9ef088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.202093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a60eb-4319-4a47-87b6-a6d77c9ef088 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.202373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a60eb-4319-4a47-87b6-a6d77c9ef088 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.202644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a60eb-4319-4a47-87b6-a6d77c9ef088 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.204079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a60eb-4319-4a47-87b6-a6d77c9ef088 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:19.205746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a60eb-4319-4a47-87b6-a6d77c9ef088 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:19.208055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 84/175] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:18 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:19.209510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.209938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.210351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.229899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.230595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.230874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.231152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.231659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:19.231904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:19.232216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:19.233559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:19.233664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:19.242909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 92/176] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:19.243648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.339793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 85/177] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:19.340686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.414922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fbc20-897e-4d0b-a236-ac11d619fef3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:19.479926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.480628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.481153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.481442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.482295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=900cdf48c6ec493f841a7267e181fefd) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:19.482611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:19.484100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:19.493636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 93/178] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:19 2022] GET /identity/v3/role_assignments?user.id=900cdf48c6ec493f841a7267e181fefd&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:19.494534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.540066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12b2f5-ea31-490a-b8bb-8e0b60179030 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:19.541001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:19.572521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:19.585421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c642bb6-b2d9-4377-93d1-e1602b17f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.586327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c642bb6-b2d9-4377-93d1-e1602b17f4df None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.586590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c642bb6-b2d9-4377-93d1-e1602b17f4df None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.586973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c642bb6-b2d9-4377-93d1-e1602b17f4df None admin] PATH_INFO: `/v3/users/900cdf48c6ec493f841a7267e181fefd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.588775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c642bb6-b2d9-4377-93d1-e1602b17f4df None admin] RBAC: Authorizing `identity:get_user(user_id=900cdf48c6ec493f841a7267e181fefd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:19.590516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c642bb6-b2d9-4377-93d1-e1602b17f4df None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:19.592242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 86/179] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:19 2022] GET /identity/v3/users/900cdf48c6ec493f841a7267e181fefd => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:19.593974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7680c7-5711-4998-ac47-1322062134e2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.594267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7680c7-5711-4998-ac47-1322062134e2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.594534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7680c7-5711-4998-ac47-1322062134e2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.595791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 87/180] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:19.597799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7680c7-5711-4998-ac47-1322062134e2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.652133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcdca5-cda1-4990-8886-86cf8aac72eb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:19.695026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9826-83d2-4bea-918d-b76b099faa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.696287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9826-83d2-4bea-918d-b76b099faa57 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.696591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9826-83d2-4bea-918d-b76b099faa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.696914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9826-83d2-4bea-918d-b76b099faa57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.711098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd9826-83d2-4bea-918d-b76b099faa57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a5bd9826-83d2-4bea-918d-b76b099faa57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:19.720416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:19.721398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:19.722193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 94/181] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:19.728499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.728499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.729689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.755590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:19.757364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:19.790690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7680c7-5711-4998-ac47-1322062134e2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:19.841684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:19.842278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:19.842556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:19.842960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:19.857503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 95/182] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:19.858451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:19.898824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:19.928582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:19.940566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:19.942210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:19.985289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8363d-32c6-4c67-a01a-1c6345f788db None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.022510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.023179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.023460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.023731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.025004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:20.025316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.027094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53b5b9-8c12-4bf2-adfb-44a2c6ab8e9a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.036537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 96/183] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.038779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad774d-8cc8-4124-b4a8-4169c9c134a7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.039288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad774d-8cc8-4124-b4a8-4169c9c134a7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.040036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad774d-8cc8-4124-b4a8-4169c9c134a7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.042232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 97/184] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:20.043131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad774d-8cc8-4124-b4a8-4169c9c134a7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.054301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 88/185] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:26:20.059593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.138307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.153400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.157232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad774d-8cc8-4124-b4a8-4169c9c134a7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.164023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efde0f-2cdf-4b42-8823-f05769754b84 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.190273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ddbf8-b062-475e-876e-6462fe5d95d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.191091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ddbf8-b062-475e-876e-6462fe5d95d4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.191373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ddbf8-b062-475e-876e-6462fe5d95d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.191647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ddbf8-b062-475e-876e-6462fe5d95d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.198048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.198919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.199193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.199799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] PATH_INFO: `/v3/users/9af1138d5a724bbc9c9469dc25095266` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.202180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ddbf8-b062-475e-876e-6462fe5d95d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1e3ddbf8-b062-475e-876e-6462fe5d95d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:20.210177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:20.211248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:20.212357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 98/186] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:20.213298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97240-de47-4d72-82bc-d107ffe9bd9a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.213298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97240-de47-4d72-82bc-d107ffe9bd9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.213298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97240-de47-4d72-82bc-d107ffe9bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.216306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] RBAC: Authorizing `identity:get_user(user_id=9af1138d5a724bbc9c9469dc25095266)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.217953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.219705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 89/187] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/users/9af1138d5a724bbc9c9469dc25095266 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.224941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.229433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c2b97240-de47-4d72-82bc-d107ffe9bd9a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:20.230617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c2b97240-de47-4d72-82bc-d107ffe9bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:20.294028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 99/188] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:20.301814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ab6a-ca83-49d8-acc3-5199db389ee1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.302282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ab6a-ca83-49d8-acc3-5199db389ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.302541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ab6a-ca83-49d8-acc3-5199db389ee1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.303846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 100/189] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:20.304557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ab6a-ca83-49d8-acc3-5199db389ee1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.327138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5595d-b29b-418f-b2d4-779fdca77dff None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.359932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.360846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.361138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.361410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] PATH_INFO: `/v3/projects/bbad5c44fc9d425c8602006bb1434dd7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.362625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] RBAC: Authorizing `identity:get_project(project_id=bbad5c44fc9d425c8602006bb1434dd7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.364106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.365826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 90/190] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/projects/bbad5c44fc9d425c8602006bb1434dd7 => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.369342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.381229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.386705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.408760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ab6a-ca83-49d8-acc3-5199db389ee1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.445183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.445935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.446484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.446994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.448205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:20.448598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.449992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629c05-cb01-4b59-90eb-805bc143ecd3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.457969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 101/191] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.459177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.459458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.459731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.476991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:20.478196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:20.479030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e72ae3-6aae-40c1-8529-6ce9f0ef4901 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.511442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.512094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.512375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.512678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.542192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 102/192] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:20.542995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.587405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.588916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.605082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.605553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.639958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f33e52-b80a-46b3-ba01-307ac147fb7d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.675193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.675922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.676221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.676499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.677684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.679158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.680843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 103/193] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.686345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.692231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 91/194] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:20.692231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.789528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae7fad-7aa5-4a0a-bc0d-6363a36e91e5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.796910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a23b-d57d-4c60-a660-9d18e89e2e66 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.806212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.824533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.825436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.825713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.825987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] PATH_INFO: `/v3/users/9af1138d5a724bbc9c9469dc25095266` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.827185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] RBAC: Authorizing `identity:get_user(user_id=9af1138d5a724bbc9c9469dc25095266)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.828691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.834621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 92/195] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/users/9af1138d5a724bbc9c9469dc25095266 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.834621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.835605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.836276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.836587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.837130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.838011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=bbad5c44fc9d425c8602006bb1434dd7, user.id=900cdf48c6ec493f841a7267e181fefd) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:20.838319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.839763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:20.841669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:20.847213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 104/196] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/role_assignments?user.id=900cdf48c6ec493f841a7267e181fefd&scope.project.id=bbad5c44fc9d425c8602006bb1434dd7&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:20.847981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:20.947509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120f694-03fb-4002-b1b2-a7e649d33c5a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.960313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90c0b4-6a17-4bec-bd85-38261f6dc961 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:20.987128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.987962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.988241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.988543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.996576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:20.997942 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:20.998220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:20.998486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:20.999210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:20.999868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:21.000688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:21.007718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:21.008780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:21.009715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 93/197] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:21.015283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.023999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 105/198] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:20 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:21.025454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.076182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:21.097458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:21.172870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099bbbc-3b5c-4650-ac4e-6417c7e32d13 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.202128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e986-4674-4657-a400-359c5e590d9b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.217333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.218224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.218509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.218788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.219991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.221523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.223252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 94/199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:21.225895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.249237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.250061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.250349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.250625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.374022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0c636-9ced-47cd-931f-3f6f08ac9cca None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.378159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.379869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.393048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:21.436399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.437128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.437437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.437681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.438447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:21.438757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.440164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.465375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:21.470010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 95/200] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:21.478079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.521196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 106/201] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:21.522441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.640160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824826e-44f0-4034-85d2-d5cf15e31521 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.642641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04de7-51d2-40fa-b031-f6632236e38b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.677969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.679027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.679406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.679782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] PATH_INFO: `/v3/users/cd6c89a96efc4a6095d8c22b9fe0a5b5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.681204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] RBAC: Authorizing `identity:get_user(user_id=cd6c89a96efc4a6095d8c22b9fe0a5b5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.683315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.684821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.685574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 107/202] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/users/cd6c89a96efc4a6095d8c22b9fe0a5b5 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:21.685809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.686212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.686600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.687554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=9af1138d5a724bbc9c9469dc25095266) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:21.687664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.688086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.689679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.697590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 96/203] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/role_assignments?user.id=9af1138d5a724bbc9c9469dc25095266&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:21.698553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:21.747317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:21.762601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:21.827666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cad01-e2ae-4a6d-a048-150ee3bf06ab None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.870200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.871564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.871993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.872594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.925626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83923895-5489-4c41-b214-cfdf6b1178ba None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:21.963117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:21.963470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.964233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:21.964662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:21.965035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:21.965596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.966435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:21.967994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:21.970054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 108/204] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:21.976297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:22.013200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:22.117069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 97/205] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:22.125977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:22.179262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:22.196679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6bd47-a52f-4ac0-af1a-7cc6055bc7b2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:22.259840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:22.260536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:22.260824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:22.261101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:22.267574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] RBAC: Adding query filter params (role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=9af1138d5a724bbc9c9469dc25095266) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:22.267858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:22.269403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:22.279869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 109/206] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:21 2022] GET /identity/v3/role_assignments?user.id=9af1138d5a724bbc9c9469dc25095266&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:22.302869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65f959-bd68-4d78-bf1c-33e08a0ad553 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:22.375280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a0f33-f839-47ca-8f65-ad3036fdd5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:22.376694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0f33-f839-47ca-8f65-ad3036fdd5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:22.377187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0f33-f839-47ca-8f65-ad3036fdd5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:22.377655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a0f33-f839-47ca-8f65-ad3036fdd5c4 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:22.382293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0f33-f839-47ca-8f65-ad3036fdd5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:22.383909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a0f33-f839-47ca-8f65-ad3036fdd5c4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:22.385834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 98/207] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:22 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:22.392001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:22.534876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9e00b-cb67-48e8-857a-0f0f4015c26b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:22.571548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:22.572595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:22.573013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:22.573292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:22.574155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] RBAC: Adding query filter params (role.id=a51e4cf245274a1c8bf99cf4b534aa86, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e, user.id=cd6c89a96efc4a6095d8c22b9fe0a5b5) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:22.574446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:22.575935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492509-5e17-475a-a8bd-51b4c05b932a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:22.582332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 110/208] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:22 2022] GET /identity/v3/role_assignments?user.id=cd6c89a96efc4a6095d8c22b9fe0a5b5&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=a51e4cf245274a1c8bf99cf4b534aa86 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:23.428370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e109-9162-4ce8-8def-e3080af9eec4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.428832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e109-9162-4ce8-8def-e3080af9eec4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.428952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e109-9162-4ce8-8def-e3080af9eec4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.430334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 99/209] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:23.435573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599a981-711d-4ade-8d01-d6e1daa18fa1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.435976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599a981-711d-4ade-8d01-d6e1daa18fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.436124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599a981-711d-4ade-8d01-d6e1daa18fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.453514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6599a981-711d-4ade-8d01-d6e1daa18fa1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:23.454690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6599a981-711d-4ade-8d01-d6e1daa18fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:23.468062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:23.528887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 111/210] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:23.531580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11af1-8823-4f21-8f4c-931f419f806e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.531866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11af1-8823-4f21-8f4c-931f419f806e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.532144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11af1-8823-4f21-8f4c-931f419f806e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.533612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 100/211] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:23.539730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.540098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.540382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.551547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11af1-8823-4f21-8f4c-931f419f806e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:23.557783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:23.558977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:23.560722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:23.632600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 112/212] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:23.652155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:23.677604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11af1-8823-4f21-8f4c-931f419f806e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:23.718891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:23.720251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.720815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.721095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.731939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:23.736373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:23.747297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:23.749077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:23.750207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 101/213] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:23.754293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:23.759759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff363-a00c-41e5-bff0-3f4197e85bf0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:23.795446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:23.796452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.796872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.797246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.798515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:23.800098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:23.802002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 113/214] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:23.807622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:23.822998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:23.860748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95d3ed-4176-4812-98f6-9a5d1bd92f97 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:23.895797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:23.896646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.896928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.897196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.898238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:23.898547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:23.899997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:23.912935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 102/215] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:23.913290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d280-23b9-4088-8d68-17936f50f97d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:23.918616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:23.952145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475983ac-7810-48d0-9fff-e37f8050df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:23.952809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475983ac-7810-48d0-9fff-e37f8050df95 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:23.953094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475983ac-7810-48d0-9fff-e37f8050df95 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:23.953371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475983ac-7810-48d0-9fff-e37f8050df95 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:23.954095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475983ac-7810-48d0-9fff-e37f8050df95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:23.955566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475983ac-7810-48d0-9fff-e37f8050df95 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:23.980593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 114/216] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:23 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:26:24.015850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df61704-10e7-4d18-a916-82e31f959bc5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.016163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df61704-10e7-4d18-a916-82e31f959bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.016401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df61704-10e7-4d18-a916-82e31f959bc5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.018406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 115/217] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:24.026032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.026032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.026032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.030450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.047940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:24.049814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:24.054871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15a6a-c3cb-425d-95de-cafb3a083ae4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.086972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.096610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.097794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.098469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.098838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] PATH_INFO: `/v3/users/08b0fd2578994667b4e359ab697a3e56` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.117366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] RBAC: Authorizing `identity:get_user(user_id=08b0fd2578994667b4e359ab697a3e56)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:24.119571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:24.124577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 103/218] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:23 2022] GET /identity/v3/users/08b0fd2578994667b4e359ab697a3e56 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:24.127609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.155596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 116/219] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:24.180321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.258940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645b74-f9e0-4486-a930-2d0d3858d707 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.304344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7561-21e4-4ae6-b0fc-e5437481ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.305050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7561-21e4-4ae6-b0fc-e5437481ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.305332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7561-21e4-4ae6-b0fc-e5437481ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.305645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7561-21e4-4ae6-b0fc-e5437481ea57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.314128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3d056-a1a8-43d7-bccd-b6bdeb37165a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.351470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.359054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.360288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.360758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.361201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.377760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:24.378172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:24.387279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:24.388233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:24.389108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 117/220] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:24.394839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.398921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7561-21e4-4ae6-b0fc-e5437481ea57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:24.401327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad7561-21e4-4ae6-b0fc-e5437481ea57 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:24.524088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2c9af-c0d9-425c-b345-66dc1c6dbfa3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.568504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 104/221] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:24.568504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f745da-c6a3-4cbe-9088-2ee3c3d420c7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.568504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f745da-c6a3-4cbe-9088-2ee3c3d420c7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.568504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f745da-c6a3-4cbe-9088-2ee3c3d420c7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.568504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 105/222] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:24.573371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f745da-c6a3-4cbe-9088-2ee3c3d420c7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.573789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.574419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.574701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.574971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.575730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:24.576224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:24.577469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88272018-a0b2-47c7-b078-e4f35b87757f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:24.587067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 118/223] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:24.592790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.593054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.593339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.610751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:24.611940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:24.666304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.696496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 119/224] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:24.696496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.696740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.728163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f745da-c6a3-4cbe-9088-2ee3c3d420c7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.766959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.767838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.768111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.768374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.770222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:24.771669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:24.773644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 106/225] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:24.778553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.829281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cb91-f58e-46af-913d-d65c55a4318a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.864565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.865821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.865963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.866286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] PATH_INFO: `/v3/users/9af1138d5a724bbc9c9469dc25095266` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.867568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] RBAC: Authorizing `identity:get_user(user_id=9af1138d5a724bbc9c9469dc25095266)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:24.869335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:24.871108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 120/226] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/users/9af1138d5a724bbc9c9469dc25095266 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:24.871950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.898276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa346-78ea-438e-a0ce-f34730a87804 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:24.929422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:24.945167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:24.946322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:24.946661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:24.947016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:24.958416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:24.966809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:24.967936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:24.968940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:24.975925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 107/227] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:24.976800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:24.986737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eef02-adf3-4dbe-8eb2-bf894b18e63b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.008976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:25.031463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.032360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.032823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.033237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.034599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=08b0fd2578994667b4e359ab697a3e56) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:25.035061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.037109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.044794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 121/228] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/role_assignments?user.id=08b0fd2578994667b4e359ab697a3e56&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:25.050144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:25.138703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827105e3-0b91-4441-b970-abb392df9411 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.211782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346123-fa0e-476a-9982-889d395cffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.213683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346123-fa0e-476a-9982-889d395cffae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.213683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346123-fa0e-476a-9982-889d395cffae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.213683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346123-fa0e-476a-9982-889d395cffae None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.216209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44346123-fa0e-476a-9982-889d395cffae None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.217711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44346123-fa0e-476a-9982-889d395cffae None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.220294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 108/229] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:24 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:25.226192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346123-fa0e-476a-9982-889d395cffae None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:25.249522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6335-565d-43bf-bd43-0ab8f2c41305 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.270392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:25.290965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.291998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.292520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.293122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.294485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:25.295118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.296886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.310980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 122/230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:25.312230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:25.361651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:25.400590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346123-fa0e-476a-9982-889d395cffae None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.445101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f1421-a910-4607-8402-057277871ad8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.482104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.483398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.483965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.484432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] PATH_INFO: `/v3/users/9af1138d5a724bbc9c9469dc25095266` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.486181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] RBAC: Authorizing `identity:get_user(user_id=9af1138d5a724bbc9c9469dc25095266)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.487976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.490450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 123/231] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:25 2022] GET /identity/v3/users/9af1138d5a724bbc9c9469dc25095266 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:25.496635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:25.553297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.554160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.554436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.554722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/9af1138d5a724bbc9c9469dc25095266/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.565279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user_id=9af1138d5a724bbc9c9469dc25095266, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.566854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.580823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:25.604609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9b431-6c75-4cca-a150-25b2a2545e18 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.619480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 109/232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:25 2022] PUT /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/9af1138d5a724bbc9c9469dc25095266/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:25.643914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba410f0-cf52-467d-b2b8-4f9ee0439e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.644831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba410f0-cf52-467d-b2b8-4f9ee0439e35 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.645168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba410f0-cf52-467d-b2b8-4f9ee0439e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.645442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba410f0-cf52-467d-b2b8-4f9ee0439e35 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.648603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba410f0-cf52-467d-b2b8-4f9ee0439e35 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.650209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba410f0-cf52-467d-b2b8-4f9ee0439e35 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.652306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 124/233] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:25 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:25.661669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:25.809673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a840-bdfc-48eb-ae76-2a438c53cf0c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:25.845641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4abab-dccc-4c97-9985-794eb64aada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:25.846604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4abab-dccc-4c97-9985-794eb64aada2 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:25.846896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4abab-dccc-4c97-9985-794eb64aada2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:25.847172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4abab-dccc-4c97-9985-794eb64aada2 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/9af1138d5a724bbc9c9469dc25095266/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:25.849480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4abab-dccc-4c97-9985-794eb64aada2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user_id=9af1138d5a724bbc9c9469dc25095266, role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:25.850947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4abab-dccc-4c97-9985-794eb64aada2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:25.869847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 110/234] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:25 2022] PUT /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/9af1138d5a724bbc9c9469dc25095266/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:26.387906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852a4b-8467-4082-bdb5-795542c46f21 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:26.388278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852a4b-8467-4082-bdb5-795542c46f21 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:26.388459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76852a4b-8467-4082-bdb5-795542c46f21 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:26.390245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 125/235] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:26.396139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bfe01-954e-498a-8db8-49817a2a47b1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:26.396429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bfe01-954e-498a-8db8-49817a2a47b1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:26.396744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bfe01-954e-498a-8db8-49817a2a47b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:26.401959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:26.414884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-266bfe01-954e-498a-8db8-49817a2a47b1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:26.416581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-266bfe01-954e-498a-8db8-49817a2a47b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:26.518990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 111/236] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:26.553777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852a4b-8467-4082-bdb5-795542c46f21 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:26.701849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76852a4b-8467-4082-bdb5-795542c46f21 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:26.725843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b70b-078e-475a-b65e-7db525c2171f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:26.726385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b70b-078e-475a-b65e-7db525c2171f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:26.726385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b70b-078e-475a-b65e-7db525c2171f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:26.727183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:26.728171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 112/237] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:26.737836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:26.738123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:26.738402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:26.751388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:26.752204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:26.752504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:26.752798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:26.764605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:26.772830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:26.773696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:26.774593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:26.775179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 126/238] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:26.781474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:26.782669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:26.787954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:26.886490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 113/239] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:26.910927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:26.967945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af2453-5a00-46a5-9d2f-d19e1dfc23de None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.018572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:27.036882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.037570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.037857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.038129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.038890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:27.039199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:27.040669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:27.051303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 127/240] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:27.056690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:27.080236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc6835-e2ab-4ffd-9256-15ea85e28423 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.096510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:27.158905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.160444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.161795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.162504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.165195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:27.167134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:27.171793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 114/241] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:27.180693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:27.202878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f16a-b12c-4851-a9b9-4bba7a4aee8d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.290126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.291037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.291317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.291586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] PATH_INFO: `/v3/users/ac3f421c785b481cb6393f35c56df266` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.318442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3f421c785b481cb6393f35c56df266)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:27.320247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:27.321456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387a18-44c6-4913-aa5f-43264206795b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.322411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 128/242] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:27 2022] GET /identity/v3/users/ac3f421c785b481cb6393f35c56df266 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:27.329457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:27.354031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:27.361958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2f068-282c-4eed-b115-ba25be9de778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.362977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2f068-282c-4eed-b115-ba25be9de778 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.363480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2f068-282c-4eed-b115-ba25be9de778 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.363947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2f068-282c-4eed-b115-ba25be9de778 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.364894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2f068-282c-4eed-b115-ba25be9de778 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:27.366726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2f068-282c-4eed-b115-ba25be9de778 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:27.390398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 115/243] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:27 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:26:27.492467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:27.500320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ca1a-6289-4fd3-971e-4f264e6c10d5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.514205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f916-3306-4a56-ade8-fd81987d9552 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.514519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f916-3306-4a56-ade8-fd81987d9552 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.514772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f916-3306-4a56-ade8-fd81987d9552 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.516280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 116/244] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:26:27.521876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.522434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.522901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.541439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:27.543040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:27.567467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.568158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.568440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.568743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.652601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 117/245] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:27.655243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:27.656861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:27.687385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:27.770751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:27.779769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 129/246] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:27.784935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:27.829617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fdf2f-6dc4-4fb8-b68b-cfde5111a69c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.853594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:27.879346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.880804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.881091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.881507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.897061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:27.907348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:27.908612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:27.909608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:27.912768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 118/247] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:27.915492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:27.926044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316731e-d2a3-43f9-81fe-c5ebee437677 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:27.981283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:27.982175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:27.982466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:27.982745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:27.985458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:27.987478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:27.989970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 130/248] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:27 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:27.997470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:28.066972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825648b2-7522-445b-8e19-8f2a2c2f0837 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:28.072829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:28.113392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:28.114001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.114282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.114553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.115310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:28.115614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:28.117077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:28.124889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b002d2-28d9-4fa5-ae71-038264eed51d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:28.126355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 119/249] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:28.133164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:28.172134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:28.172923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.173205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.173479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.174546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] RBAC: Adding query filter params (role.id=a51e4cf245274a1c8bf99cf4b534aa86, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=ac3f421c785b481cb6393f35c56df266) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:28.174886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:28.176531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed380b5-3518-45f6-8411-47a3b7196347 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:28.184603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 131/250] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:27 2022] GET /identity/v3/role_assignments?user.id=ac3f421c785b481cb6393f35c56df266&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=a51e4cf245274a1c8bf99cf4b534aa86 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:28.189086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:28.265266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f3e4-dc49-4d6a-b8e8-c0c5f75ab1bb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.265912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f3e4-dc49-4d6a-b8e8-c0c5f75ab1bb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.266382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f3e4-dc49-4d6a-b8e8-c0c5f75ab1bb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.268004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 132/251] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:28.273690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654175-c9fe-4601-8aa0-d78718327303 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.274373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654175-c9fe-4601-8aa0-d78718327303 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.274845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f654175-c9fe-4601-8aa0-d78718327303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.275268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144f0b-d92b-428a-9ebe-a6211a7cfcfd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:28.313603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9f654175-c9fe-4601-8aa0-d78718327303 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:28.315297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9f654175-c9fe-4601-8aa0-d78718327303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:28.331737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:28.333143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.333452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.333727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] PATH_INFO: `/v3/users/08b0fd2578994667b4e359ab697a3e56` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.335962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] RBAC: Authorizing `identity:get_user(user_id=08b0fd2578994667b4e359ab697a3e56)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:28.337737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:28.341452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 120/252] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:28 2022] GET /identity/v3/users/08b0fd2578994667b4e359ab697a3e56 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:28.347813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:28.477211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 133/253] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:28.479096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89baa-f72e-4ff5-81df-b215302933f5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.479602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89baa-f72e-4ff5-81df-b215302933f5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.480148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89baa-f72e-4ff5-81df-b215302933f5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.481789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 134/254] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:28.489885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.490436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.490608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc9fc-a524-4245-a7ab-960c1e43ee4a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:28.491067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.498116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:28.514458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:28.516291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:28.573784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:28.574694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.574982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.575267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.581243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:28.582745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:28.584906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 121/255] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:28 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:28.585824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:28.587456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:28.607073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 135/256] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:28.607981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:28.719601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d024c1c-1969-43ae-8a8e-257748c80529 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:28.754606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:28.755617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.755912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.756191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/08b0fd2578994667b4e359ab697a3e56/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.758313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user_id=08b0fd2578994667b4e359ab697a3e56, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:28.759971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:28.780793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 136/257] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:28 2022] PUT /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/08b0fd2578994667b4e359ab697a3e56/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:28.782449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:28.836064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c93f0-5bdc-4591-923e-f7c3cea1c410 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:28.908585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:28.910315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:28.911289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:28.911578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:28.911912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:28.935415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:28.944263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:28.945606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:28.946468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:28.950629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 122/258] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:28.957364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:29.006372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6ee15-dc2d-47ae-a172-5d80f3aa4fa7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.024110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:29.064640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699421-def7-4d84-a44a-799810d4683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.065454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699421-def7-4d84-a44a-799810d4683b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.065729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699421-def7-4d84-a44a-799810d4683b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.066022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699421-def7-4d84-a44a-799810d4683b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.085896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57699421-def7-4d84-a44a-799810d4683b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-57699421-def7-4d84-a44a-799810d4683b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:29.094018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:29.094920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:29.095729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 137/259] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:29.111549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699421-def7-4d84-a44a-799810d4683b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:29.156433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69d69-73e9-4cbf-822d-e9a8327c093e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.231526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.232211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.232504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.232781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.233528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:29.233833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:29.235208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:29.263187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 123/260] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:29.266513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:29.326883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699421-def7-4d84-a44a-799810d4683b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.340623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:29.388173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.388876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.389153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.389420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.390167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:29.390468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:29.391886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:29.412027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 138/261] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:29.419984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:29.455802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:29.466992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b365-bb35-4566-afb7-f2abe261d30b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.565210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.566508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.566987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.567479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] PATH_INFO: `/v3/users/9af1138d5a724bbc9c9469dc25095266` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.569032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] RBAC: Authorizing `identity:get_user(user_id=9af1138d5a724bbc9c9469dc25095266)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:29.571201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:29.573201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 124/262] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:29 2022] GET /identity/v3/users/9af1138d5a724bbc9c9469dc25095266 => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:29.579295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:29.636149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9d0ae-3a48-47d4-bf5d-07b54fc13a0d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.698536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.699440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.699726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.700006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] PATH_INFO: `/v3/users/9af1138d5a724bbc9c9469dc25095266` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.705231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] RBAC: Authorizing `identity:get_user(user_id=9af1138d5a724bbc9c9469dc25095266)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:29.706934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:29.709116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 139/263] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:29 2022] GET /identity/v3/users/9af1138d5a724bbc9c9469dc25095266 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:29.714417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:29.758225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c2ab-2868-406b-8298-81cc6d5dcb96 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.780853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:29.817276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.817872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.818163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.818443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.869651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:29.896228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e1632-434e-4e2a-8f4e-20480713487f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:29.953891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:29.955042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:29.955530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:29.955996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:29.960498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:29.960498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:30.081329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:30.083209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:30.145607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:30.157222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 125/264] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:30.173817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:30.250277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 140/265] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:26:30.256137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:30.276963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:30.332301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d1fa8-ee08-4045-b981-cc84a0cc2a54 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:30.394075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:30.394971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.395255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.395540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.401247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:30.402743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:30.404733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 126/266] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:30 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:30.413667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:30.546421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb053c-94e0-4102-b0ae-58d5c1c9dcb4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:30.561208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec4a3-2a3e-4d79-a669-c4966ade4303 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:30.609194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:30.615987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:30.616691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.617336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.618198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=9af1138d5a724bbc9c9469dc25095266) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:30.618522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:30.620011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:30.629374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 127/267] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:30 2022] GET /identity/v3/role_assignments?user.id=9af1138d5a724bbc9c9469dc25095266&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:30.652694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01a299-e2c9-4f43-b787-3a90f6794ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:30.653627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01a299-e2c9-4f43-b787-3a90f6794ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.653909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01a299-e2c9-4f43-b787-3a90f6794ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.654180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01a299-e2c9-4f43-b787-3a90f6794ac0 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.655367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01a299-e2c9-4f43-b787-3a90f6794ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:30.656877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01a299-e2c9-4f43-b787-3a90f6794ac0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:30.659033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 141/268] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:30 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:30.665362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:30.678525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68de0-ca4c-4eb5-944e-bee240e18703 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.679157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68de0-ca4c-4eb5-944e-bee240e18703 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.679627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68de0-ca4c-4eb5-944e-bee240e18703 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.682568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 142/269] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:30.688786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.689578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.690056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.702215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:30.722408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:30.725333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:30.863832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a41d5-3e40-4c8e-8ee2-ec32218185e9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:30.867408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 143/270] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:30.918387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:30.919793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.920291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.920783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.922853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:30.924685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] RBAC: Adding query filter params (role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=9af1138d5a724bbc9c9469dc25095266) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:30.925052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:30.926600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeb648-ffdc-4ca6-9c66-e61f0f76a9e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:30.936501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 128/271] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:30 2022] GET /identity/v3/role_assignments?user.id=9af1138d5a724bbc9c9469dc25095266&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:30.936501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d626-2e29-4c08-8f50-2e23afce1efe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.936501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d626-2e29-4c08-8f50-2e23afce1efe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.936501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56d626-2e29-4c08-8f50-2e23afce1efe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.937112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 129/272] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:30.942657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1039-8f8e-408e-ac1e-4f7b64f11e13 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:30.942935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1039-8f8e-408e-ac1e-4f7b64f11e13 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:30.943198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe1039-8f8e-408e-ac1e-4f7b64f11e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:30.961721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5afe1039-8f8e-408e-ac1e-4f7b64f11e13 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:30.963007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5afe1039-8f8e-408e-ac1e-4f7b64f11e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:31.038672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.060575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 130/273] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:31.060575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5a73-71ba-4aae-a1b7-2557c4e7ca78 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.060575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5a73-71ba-4aae-a1b7-2557c4e7ca78 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.060575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5a73-71ba-4aae-a1b7-2557c4e7ca78 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.060575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 131/274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:31.066070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.066363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.066647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.092833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:31.094046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:31.102178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8af80-8dfd-4c3b-b162-cdc5e203f874 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.151022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.152367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.152882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.153329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.155480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.169778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:31.179193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:31.180120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:31.181016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 144/275] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:31.181665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.183594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 132/276] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:31.192828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.305295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47d86b-4acc-4adc-a685-1029911325c5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.312095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38d330-19c8-45a8-bf4b-e38b7db0deb4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.334856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.348561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.349402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.349686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.349957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.350751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.351436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.351831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.352108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.353029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:31.353338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.354727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.360135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:31.363746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 133/277] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:31.365410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:31.368441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:31.369338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:31.370131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 145/278] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:31.370780 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.434254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.475311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6103dc8-6e3b-482c-9896-928f535dc7a1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.484989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68fd2-0cb3-4a55-9960-49edb4fa2148 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.511898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.512748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.513041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.513316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.514488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.515945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.522208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 134/279] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:31.522353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.522462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.522547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.522547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.522547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] PATH_INFO: `/v3/users/2f2d95cbea71492fbb0c8182d21ccc5a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.537691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] RBAC: Authorizing `identity:get_user(user_id=2f2d95cbea71492fbb0c8182d21ccc5a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.539240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.541180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 146/280] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/users/2f2d95cbea71492fbb0c8182d21ccc5a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:31.541766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.581073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.633617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f40a16-7a5a-47aa-ad64-cfeea167004d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.649124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b4425-a4d5-4358-b41c-2e615a091b9e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.662216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.668512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.669215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.669496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.669765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.670514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:31.670820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.672215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.680865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 135/281] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:31.681888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.686222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87e93-6ea4-4330-9374-d31d151382b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.686897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87e93-6ea4-4330-9374-d31d151382b9 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.687184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87e93-6ea4-4330-9374-d31d151382b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.687449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87e93-6ea4-4330-9374-d31d151382b9 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.688150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87e93-6ea4-4330-9374-d31d151382b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.689640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87e93-6ea4-4330-9374-d31d151382b9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.712347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 147/282] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:31 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:31.713648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d32ca-5d01-4c36-bc18-d3b1243ff78e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.713935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d32ca-5d01-4c36-bc18-d3b1243ff78e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.714503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d32ca-5d01-4c36-bc18-d3b1243ff78e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.716511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 148/283] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:31.716743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d32ca-5d01-4c36-bc18-d3b1243ff78e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.795854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b054f-bb94-4c50-9ac3-137d06e3eddd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.810876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.837755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.838468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.838745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.839020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.840276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, user.id=2f2d95cbea71492fbb0c8182d21ccc5a, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:31.840877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.842000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d32ca-5d01-4c36-bc18-d3b1243ff78e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:31.843068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28f9af-d176-4b9c-932b-74f8d125f3ff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.850606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 136/284] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/role_assignments?user.id=2f2d95cbea71492fbb0c8182d21ccc5a&scope.system=all&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:31.851870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.852161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.852590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.873097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:31.875216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:31.896226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:31.897325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:31.897681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:31.898024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] PATH_INFO: `/v3/users/ac3f421c785b481cb6393f35c56df266` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:31.899444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3f421c785b481cb6393f35c56df266)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:31.901093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:31.903110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 149/285] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/users/ac3f421c785b481cb6393f35c56df266 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:31.908833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:31.953792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:31.966780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 137/286] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:31.991083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:32.030785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70663278-b49d-48a3-aa42-ec1910fed719 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:32.071567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:32.073165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:32.073453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:32.073726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:32.074939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:32.076400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:32.078356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 150/287] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:32.083935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:32.123234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fea2b-4442-4833-aecc-fb26adb4092b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:32.137108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:32.167647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:32.168263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:32.168582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:32.168860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:32.180401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:32.188392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:32.189329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:32.190127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 138/288] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:32.197633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:32.222966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fba1-d372-4860-bb5f-3023a99a1407 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:32.226129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:32.267452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:32.269304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:32.269799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:32.270387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/ac3f421c785b481cb6393f35c56df266/roles/a51e4cf245274a1c8bf99cf4b534aa86` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:32.273230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user_id=ac3f421c785b481cb6393f35c56df266, role_id=a51e4cf245274a1c8bf99cf4b534aa86)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:32.275736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:32.302332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 151/289] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:26:32 2022] PUT /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/users/ac3f421c785b481cb6393f35c56df266/roles/a51e4cf245274a1c8bf99cf4b534aa86 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:26:32.329609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055837a1-9981-4f6b-b8d0-60b084a3cb8d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:32.370840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:32.371973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:32.372437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:32.372911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:32.373928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:32.374432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:32.376042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:32.390146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 139/290] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:32.392981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:32.554920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9249789-885b-426b-9788-3a78b060a851 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:32.593833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:32.595083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:32.595541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:32.596037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] PATH_INFO: `/v3/users/08b0fd2578994667b4e359ab697a3e56` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:32.597625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] RBAC: Authorizing `identity:get_user(user_id=08b0fd2578994667b4e359ab697a3e56)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:32.599270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:32.601493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 152/291] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:32 2022] GET /identity/v3/users/08b0fd2578994667b4e359ab697a3e56 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:32.609276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:32.640159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:32.715816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085079ab-4a9b-4835-931a-b376f3768d91 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:32.751248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:32.751966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:32.752251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:32.752581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:32.821962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:32.823383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:32.850446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:32.922265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 140/292] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:32.927978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:32.966198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:33.058547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2206-662a-4df2-bbc5-8f169f0bacf1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:33.106722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384b4ca-711e-4171-ae9c-c5abbb4639e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:33.107537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b4ca-711e-4171-ae9c-c5abbb4639e9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:33.107814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b4ca-711e-4171-ae9c-c5abbb4639e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:33.108092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384b4ca-711e-4171-ae9c-c5abbb4639e9 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:33.109320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b4ca-711e-4171-ae9c-c5abbb4639e9 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:33.110782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384b4ca-711e-4171-ae9c-c5abbb4639e9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:33.112529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 153/293] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:32 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:33.118611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:33.222672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f959a8-dcd7-4e37-9a68-65e3f745a1f2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:33.249123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:33.257047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:33.257978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:33.258489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:33.258820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:33.259669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=08b0fd2578994667b4e359ab697a3e56) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:33.259983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:33.261474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecbf7-442d-4ed8-a3b8-75dcbc8e6a85 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:33.268112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 141/294] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:33 2022] GET /identity/v3/role_assignments?user.id=08b0fd2578994667b4e359ab697a3e56&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:34.171705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ee24-84da-4cc1-9f4c-a2bee9991e4a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.172278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ee24-84da-4cc1-9f4c-a2bee9991e4a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.172278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ee24-84da-4cc1-9f4c-a2bee9991e4a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.173903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 154/295] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:34.179463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0591-6fb6-4a28-a416-b77e98755a03 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.179954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0591-6fb6-4a28-a416-b77e98755a03 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.180050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0591-6fb6-4a28-a416-b77e98755a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.197559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5bbe0591-6fb6-4a28-a416-b77e98755a03 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:34.198756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5bbe0591-6fb6-4a28-a416-b77e98755a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:34.267319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 142/296] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:34.289738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ee24-84da-4cc1-9f4c-a2bee9991e4a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.298028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbdffc-4d73-438a-adba-2ae6112795d4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.298318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbdffc-4d73-438a-adba-2ae6112795d4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.298609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbdffc-4d73-438a-adba-2ae6112795d4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.299994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 143/297] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:34.305043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.305659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.306094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.323807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:34.325249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:34.393566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 144/298] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:34.417032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.419684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:34.423456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ee24-84da-4cc1-9f4c-a2bee9991e4a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.458551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014172e4-789d-49cb-83e1-009c485257ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.459849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014172e4-789d-49cb-83e1-009c485257ce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.460343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014172e4-789d-49cb-83e1-009c485257ce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.460946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014172e4-789d-49cb-83e1-009c485257ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.470111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:34.473873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014172e4-789d-49cb-83e1-009c485257ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-014172e4-789d-49cb-83e1-009c485257ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:34.482336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:34.483380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:34.484387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:34.486909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 155/299] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:34.488353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06e3c-ac83-4d8b-8863-fb02bd9524dd None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.488674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06e3c-ac83-4d8b-8863-fb02bd9524dd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.488952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06e3c-ac83-4d8b-8863-fb02bd9524dd None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.490354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 156/300] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:34.492009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06e3c-ac83-4d8b-8863-fb02bd9524dd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.524956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6ac5-abe2-4b2f-89d5-162c55f5c02b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.559984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604fb54-9d7b-4105-afb2-7760aaf8624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.560822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604fb54-9d7b-4105-afb2-7760aaf8624e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.561102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604fb54-9d7b-4105-afb2-7760aaf8624e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.561368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604fb54-9d7b-4105-afb2-7760aaf8624e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.571864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604fb54-9d7b-4105-afb2-7760aaf8624e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b604fb54-9d7b-4105-afb2-7760aaf8624e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:34.579481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:34.580359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:34.581176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 145/301] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:34.582528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.582528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.582528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.602413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:34.603740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:34.605901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06e3c-ac83-4d8b-8863-fb02bd9524dd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.639537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99b60-8968-468d-82df-1c745436f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.640201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99b60-8968-468d-82df-1c745436f572 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.640489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99b60-8968-468d-82df-1c745436f572 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.640772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99b60-8968-468d-82df-1c745436f572 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.641514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99b60-8968-468d-82df-1c745436f572 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:34.641816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99b60-8968-468d-82df-1c745436f572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:34.643211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99b60-8968-468d-82df-1c745436f572 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:34.655751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 157/302] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:34.655751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99b60-8968-468d-82df-1c745436f572 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.678956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:34.682128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 146/303] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:34.682980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.737183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:34.767698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99b60-8968-468d-82df-1c745436f572 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.796566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98798-918f-4c48-a10d-1fd071524f3a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.801591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.802260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.802542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.802809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.803541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:34.803843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:34.805250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:34.818056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 158/304] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:34.818917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.831014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.831903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.832181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.832451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] PATH_INFO: `/v3/users/2f2d95cbea71492fbb0c8182d21ccc5a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.833656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] RBAC: Authorizing `identity:get_user(user_id=2f2d95cbea71492fbb0c8182d21ccc5a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:34.835103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:34.836778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 147/305] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/users/2f2d95cbea71492fbb0c8182d21ccc5a => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:34.837531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.905240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:34.920583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfe7e4-6a12-496c-b63b-3ee560f59d41 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.936270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82deb93-565c-4c09-9ed4-bf29dfbeb34f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:34.946797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:34.952829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.953626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.953901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.954205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.955343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:34.956816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:34.958399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 159/306] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:34.959126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:34.971335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088518fe-32c8-4a5a-a36c-5794cb50594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:34.972245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088518fe-32c8-4a5a-a36c-5794cb50594c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.972520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088518fe-32c8-4a5a-a36c-5794cb50594c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.972801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088518fe-32c8-4a5a-a36c-5794cb50594c None admin] PATH_INFO: `/v3/users/aebca333fb48460292a46067c8ae4e56` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.986760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088518fe-32c8-4a5a-a36c-5794cb50594c None admin] RBAC: Authorizing `identity:get_user(user_id=aebca333fb48460292a46067c8ae4e56)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:34.988204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088518fe-32c8-4a5a-a36c-5794cb50594c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:34.989874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 148/307] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:34 2022] GET /identity/v3/users/aebca333fb48460292a46067c8ae4e56 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:34.991116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7b1cc-1c6e-478f-a0b9-418508d75da5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:34.991393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7b1cc-1c6e-478f-a0b9-418508d75da5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:34.991660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7b1cc-1c6e-478f-a0b9-418508d75da5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:34.992913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 149/308] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:34.993584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7b1cc-1c6e-478f-a0b9-418508d75da5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:35.068384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31c31-c665-4906-ba16-f8aeb707b7a9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.091282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7b1cc-1c6e-478f-a0b9-418508d75da5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.102730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.103613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.103898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.104169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] PATH_INFO: `/v3/system/users/2f2d95cbea71492fbb0c8182d21ccc5a/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.105705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2f2d95cbea71492fbb0c8182d21ccc5a, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:35.107087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:35.118679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 160/309] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jul 21 05:26:34 2022] PUT /identity/v3/system/users/2f2d95cbea71492fbb0c8182d21ccc5a/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:35.119622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:35.137171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f2edb-bc4c-4fd1-8264-31b710acccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.137871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2edb-bc4c-4fd1-8264-31b710acccea None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.138149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2edb-bc4c-4fd1-8264-31b710acccea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.138416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f2edb-bc4c-4fd1-8264-31b710acccea None admin] PATH_INFO: `/v3/groups` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.139127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f2edb-bc4c-4fd1-8264-31b710acccea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:35.140718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f2edb-bc4c-4fd1-8264-31b710acccea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:35.148557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:35.158932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 150/310] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jul 21 05:26:34 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:35.160451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.160758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.161089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.195031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:35.197715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:35.236986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:35.272138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c244a-3955-498b-9af0-d108be1c2b22 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.293465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 151/311] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:35.316969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:35.321816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.322784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.323211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.323655 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.324703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] RBAC: Adding query filter params (role.id=a51e4cf245274a1c8bf99cf4b534aa86, user.id=aebca333fb48460292a46067c8ae4e56, scope.system=all) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:35.325161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:35.326806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:35.333504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 161/312] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jul 21 05:26:35 2022] GET /identity/v3/role_assignments?user.id=aebca333fb48460292a46067c8ae4e56&scope.system=all&role.id=a51e4cf245274a1c8bf99cf4b534aa86 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:35.447829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b772-fcff-4429-bbe5-5f7403738e81 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.485768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.486595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.486877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.487162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.499188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:35.507260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:35.508169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:35.509497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 152/313] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:35.515005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:35.597504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:35.617637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af7908-e2da-478b-ade7-f462c3cac7ad None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.652945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.653636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.653919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.654195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.654951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:35.655259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:35.656697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:35.665841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 162/314] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:35.671271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:35.701010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:35.776281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504590-4d60-4cca-81d3-ed13710356c5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.810205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.811104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.811383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.811651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] PATH_INFO: `/v3/users/ac3f421c785b481cb6393f35c56df266` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.814397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3f421c785b481cb6393f35c56df266)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:35.815867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:35.817526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 153/315] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:35 2022] GET /identity/v3/users/ac3f421c785b481cb6393f35c56df266 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:35.825589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:35.930792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf79a1-3e64-4d33-8ddb-cdf93b3f3006 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:35.966580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:35.967156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:35.967439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:35.967718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:35.992872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:36.036354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:36.037936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:36.135888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 163/316] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:36.141268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:36.231686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:36.246844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973f5a-53db-410d-b279-3cd35fd5c356 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:36.281559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f8a1-e7d5-4843-bcc1-bf1bcfe799c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:36.282437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f8a1-e7d5-4843-bcc1-bf1bcfe799c4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:36.282721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f8a1-e7d5-4843-bcc1-bf1bcfe799c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:36.282995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f8a1-e7d5-4843-bcc1-bf1bcfe799c4 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:36.284195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f8a1-e7d5-4843-bcc1-bf1bcfe799c4 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:36.285702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f8a1-e7d5-4843-bcc1-bf1bcfe799c4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:36.287597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 154/317] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:36 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:36.293913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:36.349125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:36.406150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659519e-d0c2-4707-9144-bdb23240a6f2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:36.441430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:36.442131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:36.442411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:36.442692 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:36.443557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] RBAC: Adding query filter params (role.id=a51e4cf245274a1c8bf99cf4b534aa86, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a, user.id=ac3f421c785b481cb6393f35c56df266) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:36.443873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:36.445789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715ad5-4e2b-46e9-9720-0d23f407eb96 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:36.452960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 164/318] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:26:36 2022] GET /identity/v3/role_assignments?user.id=ac3f421c785b481cb6393f35c56df266&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=a51e4cf245274a1c8bf99cf4b534aa86 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:37.231439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71879-6187-4956-837b-150ef4f786ce None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.231821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71879-6187-4956-837b-150ef4f786ce None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.232410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71879-6187-4956-837b-150ef4f786ce None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.233443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 155/319] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:37.238768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99b3d6-fad9-4525-ab14-3c92a5edbcff None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.239065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99b3d6-fad9-4525-ab14-3c92a5edbcff None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.239313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99b3d6-fad9-4525-ab14-3c92a5edbcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.256028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4c99b3d6-fad9-4525-ab14-3c92a5edbcff None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:37.257307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4c99b3d6-fad9-4525-ab14-3c92a5edbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:37.327572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 165/320] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:37.350565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d71879-6187-4956-837b-150ef4f786ce None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.364316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb77d-5556-4a73-aed7-1e0e513d1998 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.364644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb77d-5556-4a73-aed7-1e0e513d1998 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.364965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939eb77d-5556-4a73-aed7-1e0e513d1998 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.366325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 166/321] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:37.371174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2f93-8674-48f4-a927-f5d123c28d50 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.371464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2f93-8674-48f4-a927-f5d123c28d50 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.371749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2f93-8674-48f4-a927-f5d123c28d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.388781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-487f2f93-8674-48f4-a927-f5d123c28d50 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:37.389964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-487f2f93-8674-48f4-a927-f5d123c28d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:37.428445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:37.466106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d71879-6187-4956-837b-150ef4f786ce None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:37.467156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 167/322] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:37.469908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a4d5-8ca7-42af-a1e6-f22c64a7bd36 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.470195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a4d5-8ca7-42af-a1e6-f22c64a7bd36 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.470470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67a4d5-8ca7-42af-a1e6-f22c64a7bd36 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.471887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 168/323] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:37.476768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.477049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.477321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.494552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:37.495660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:37.499661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:37.500521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.500796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.501064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.511777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:37.519409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:37.520336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:37.521175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 156/324] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:37.521827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.537682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:37.565117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 169/325] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:37.572343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.622985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8db19f-031c-40d7-9f80-b521fee58568 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:37.656924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:37.657730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.658011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.658281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.658397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:37.659478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:37.661026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:37.662851 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 157/326] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:37.663608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.665243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05322e-906f-4d2f-9173-c880aec7452a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:37.702336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:37.703022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.703306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.703582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.704335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:37.704672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:37.706088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:37.714499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 170/327] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:37.715278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.764789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:37.784600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806b85-a672-4034-ae59-24a1302b0c73 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:37.818791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:37.819592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.820055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f19aa-3073-4cf9-aafc-e2949a6c0f08 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:37.820228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.820519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.831359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:37.838914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:37.839778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:37.840604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 158/328] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:37.841266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.854857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:37.855620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.855884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:37.856185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] PATH_INFO: `/v3/groups` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:37.856876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:37.858354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:37.873971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 171/329] 10.222.0.18 () {60 vars in 1134 bytes} [Thu Jul 21 05:26:37 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:37.874767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:37.909060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:37.960366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e5055-9f2a-4b80-931f-266fa19e9fa1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:37.998371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:37.999466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:37.999824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:38.000168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] PATH_INFO: `/v3/users/2f2d95cbea71492fbb0c8182d21ccc5a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:38.001513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] RBAC: Authorizing `identity:get_user(user_id=2f2d95cbea71492fbb0c8182d21ccc5a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:38.002021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21e236-8b53-44f1-a8a1-838e642c98c3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:38.003067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:38.005188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 159/330] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:37 2022] GET /identity/v3/users/2f2d95cbea71492fbb0c8182d21ccc5a => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:38.011492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:38.027068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:38.046672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:38.047738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:38.048026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:38.048307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:38.049787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:38.050109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:38.051714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:38.061036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 172/331] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:38.067709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:38.147875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f87c47-6853-4d5c-8ebb-04e61656b6df None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:38.172726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:38.192922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:38.193599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:38.193886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:38.194165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:38.195377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] RBAC: Adding query filter params (role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, user.id=2f2d95cbea71492fbb0c8182d21ccc5a, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:38.195691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:38.196228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7a0df-deed-4ff5-929b-696555d2860b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:38.197183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:38.213130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 160/332] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jul 21 05:26:38 2022] GET /identity/v3/role_assignments?user.id=2f2d95cbea71492fbb0c8182d21ccc5a&scope.system=all&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:38.239726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5fd3d-1614-48c4-87e4-515bcf5c7093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:38.240986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5fd3d-1614-48c4-87e4-515bcf5c7093 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:38.241415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5fd3d-1614-48c4-87e4-515bcf5c7093 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:38.241831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5fd3d-1614-48c4-87e4-515bcf5c7093 None admin] PATH_INFO: `/v3/users/aebca333fb48460292a46067c8ae4e56` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:38.243491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5fd3d-1614-48c4-87e4-515bcf5c7093 None admin] RBAC: Authorizing `identity:get_user(user_id=aebca333fb48460292a46067c8ae4e56)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:38.245307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5fd3d-1614-48c4-87e4-515bcf5c7093 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:38.247662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 173/333] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:38 2022] GET /identity/v3/users/aebca333fb48460292a46067c8ae4e56 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:38.253368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:38.331555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:38.374967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274ee92-e6c4-461f-860a-00dd7d6684b2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:38.430590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e310f3-f766-4756-ab07-6adc5920ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:38.431492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e310f3-f766-4756-ab07-6adc5920ac14 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:38.431770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e310f3-f766-4756-ab07-6adc5920ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:38.432045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e310f3-f766-4756-ab07-6adc5920ac14 None admin] PATH_INFO: `/v3/system/users/aebca333fb48460292a46067c8ae4e56/roles/a51e4cf245274a1c8bf99cf4b534aa86` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:38.434937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e310f3-f766-4756-ab07-6adc5920ac14 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aebca333fb48460292a46067c8ae4e56, role_id=a51e4cf245274a1c8bf99cf4b534aa86)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:38.436345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e310f3-f766-4756-ab07-6adc5920ac14 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:38.449569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 161/334] 10.222.0.18 () {58 vars in 1334 bytes} [Thu Jul 21 05:26:38 2022] PUT /identity/v3/system/users/aebca333fb48460292a46067c8ae4e56/roles/a51e4cf245274a1c8bf99cf4b534aa86 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:40.535107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0d67-76d2-40da-85f0-380726d1599b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.536074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0d67-76d2-40da-85f0-380726d1599b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.536600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0d67-76d2-40da-85f0-380726d1599b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.538423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 174/335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:40.544183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdac2a-63de-48b2-87a3-7f1ed8187535 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.545022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdac2a-63de-48b2-87a3-7f1ed8187535 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.545487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdac2a-63de-48b2-87a3-7f1ed8187535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.560430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d756-c106-47b8-9d96-2df00e53825c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.561102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d756-c106-47b8-9d96-2df00e53825c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.561571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d756-c106-47b8-9d96-2df00e53825c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.563387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 175/336] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:40.566556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a8fdac2a-63de-48b2-87a3-7f1ed8187535 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:40.567810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a8fdac2a-63de-48b2-87a3-7f1ed8187535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:40.569149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.570021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.570510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.601350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:40.603806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:40.714015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 162/337] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:40.742034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 176/338] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:40.765622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27636-19d7-4e8a-8b1c-5abfb72a90f8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.766214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27636-19d7-4e8a-8b1c-5abfb72a90f8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.766684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27636-19d7-4e8a-8b1c-5abfb72a90f8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.768541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 163/339] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:40.771648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:40.782196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.782810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.783280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.821513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:40.823199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:40.863736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:40.903244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fe1bd-eecc-4e7c-94f0-db0941acde74 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:40.941336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:40.942870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:40.943646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:40.944062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:40.944970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:40.958692 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:40.967150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 164/340] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:40.967682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:40.968539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:40.969321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:40.969901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:40.972330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 177/341] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:40.982473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.105733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84df033-a73a-4937-88b4-f32adc50ab13 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.124260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417f07-c8af-4fd8-877a-47c81510cc4c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.143169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.143989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.148498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.148498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.156046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:41.164236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:41.165494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:41.166295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 165/342] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:41.166992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.207284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.208001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.208283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.208682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.209437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:41.209743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:41.211140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:41.223633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:41.225735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:41.230652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 178/343] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:41.231487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.278657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bc581-0c84-4e5e-91ee-c775f209bf17 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.318401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.319291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.319960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.320241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.332464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:41.341775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:41.342684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:41.343485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 166/344] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:41.344721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.459295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c89f5e-6ba3-4454-a4ec-75531ec02ebd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.476945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:41.494764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d581-30b8-4c07-9b79-5a54026c8f6e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.495726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd7a55-2e1c-4aea-8064-008f38b93189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.496553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd7a55-2e1c-4aea-8064-008f38b93189 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.496951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd7a55-2e1c-4aea-8064-008f38b93189 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.497328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd7a55-2e1c-4aea-8064-008f38b93189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.551965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.552691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.553187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.553646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.554996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:41.555722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:41.557844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:41.567419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 179/345] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:41.568542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.619433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd7a55-2e1c-4aea-8064-008f38b93189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:41.621636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd7a55-2e1c-4aea-8064-008f38b93189 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:41.633822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:41.673788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3628f83-97b0-4bd8-bc5b-5fcb78811159 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.712179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.713228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.713524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.713809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.714562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:41.714873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:41.716272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:41.727576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 180/346] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:41.728691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.777704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 167/347] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:41.779108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b24c91-990c-42e2-a8aa-b480b0a7da48 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.779579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b24c91-990c-42e2-a8aa-b480b0a7da48 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.779993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b24c91-990c-42e2-a8aa-b480b0a7da48 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.781455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 168/348] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:41.782916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2a05-3eca-4560-b36c-7a3b5764e5da None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.783353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2a05-3eca-4560-b36c-7a3b5764e5da None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.783637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec2a05-3eca-4560-b36c-7a3b5764e5da None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.789117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 169/349] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:41.790119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec2a05-3eca-4560-b36c-7a3b5764e5da None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:41.806400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:41.869700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e70f7-dc93-41a3-881e-30a6a33aa6bf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.896198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:41.915343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.916573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.916999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.917410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:41.919141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec2a05-3eca-4560-b36c-7a3b5764e5da None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:41.964527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d800f2-74c8-44e2-8d4f-1fc68681045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:41.966382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d800f2-74c8-44e2-8d4f-1fc68681045a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:41.966818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d800f2-74c8-44e2-8d4f-1fc68681045a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:41.967235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d800f2-74c8-44e2-8d4f-1fc68681045a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.003616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.005928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.056353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d800f2-74c8-44e2-8d4f-1fc68681045a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.058121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d800f2-74c8-44e2-8d4f-1fc68681045a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.074935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.139119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 181/350] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:42.139978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.172301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.196921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 170/351] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:42.198690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96fcfb-9890-4134-b0bd-02a833aa3b72 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.199076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96fcfb-9890-4134-b0bd-02a833aa3b72 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.199935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96fcfb-9890-4134-b0bd-02a833aa3b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.221593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4b96fcfb-9890-4134-b0bd-02a833aa3b72 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:42.222808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4b96fcfb-9890-4134-b0bd-02a833aa3b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:42.269812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e737-f465-45c4-aec8-3c6b186293ea None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.318121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.319033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.319486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.319977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 171/352] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:42.320531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.322114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.323720 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.325551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.325732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 182/353] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:42.325826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.326108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.326477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.357670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:42.359230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:42.415841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.451514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.451704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 172/354] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:42.452525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.471376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed9e9-1ffc-4f8d-a519-243e5d401a2c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.508930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.509824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.510106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.510382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.511587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.513194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.514897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 183/355] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:42.515673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.566585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa4af6-61bd-477f-a785-2052e9aaffd0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.612867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.613745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.614191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.614609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.618826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.620318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.622238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 173/356] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:42.623152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.630759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42644d-4027-4393-aab8-a85522147a2f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.672369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619d65f-4d20-4c81-8fae-bd9f42b079ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.673271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619d65f-4d20-4c81-8fae-bd9f42b079ba None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.673553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619d65f-4d20-4c81-8fae-bd9f42b079ba None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.673825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619d65f-4d20-4c81-8fae-bd9f42b079ba None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.674609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.682342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619d65f-4d20-4c81-8fae-bd9f42b079ba None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.683807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619d65f-4d20-4c81-8fae-bd9f42b079ba None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.685543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 184/357] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:42.686965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bddc35-a826-4cb7-9c16-5e2a4ae7832f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.687443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bddc35-a826-4cb7-9c16-5e2a4ae7832f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.687711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bddc35-a826-4cb7-9c16-5e2a4ae7832f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.689109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 185/358] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:42.689933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bddc35-a826-4cb7-9c16-5e2a4ae7832f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.717120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.741957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133911-2a9e-4ed9-9a1e-f36c2e42d600 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.782553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.783377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.783662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.783932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.795984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:42.802902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bddc35-a826-4cb7-9c16-5e2a4ae7832f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:42.803733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:42.804719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 05:26:42.805627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:42.806263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 174/359] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:42.806652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.848607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.849361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.849645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.850425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.861859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:42.870135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:42.871038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:42.871903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 186/360] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:42.872634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.940173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9e7db-24c0-41e0-ab83-1e057c1d74b0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:42.942916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.975059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:42.984261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:42.985173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:42.985455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:42.985808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:42.986903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:42.988354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:42.990771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 175/361] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:42.990771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:42.994161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce23e0a-43d7-45e6-a258-a9385877155b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.033423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0603-cce2-4322-a201-1a748555c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.034302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0603-cce2-4322-a201-1a748555c547 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.034581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0603-cce2-4322-a201-1a748555c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.034850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0603-cce2-4322-a201-1a748555c547 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.037711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0603-cce2-4322-a201-1a748555c547 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.038218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0603-cce2-4322-a201-1a748555c547 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.040102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 187/362] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.041149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.041435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.041710 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.060910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:43.062143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:43.111730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73401ae-99af-4ec2-98f7-3799bbccbee7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.136535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 188/363] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:43.137402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.149505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.150631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.151019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.151656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.152528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:43.152872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.154450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.160548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 176/364] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:42 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.161373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.206015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:43.249791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:43.275043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b3add-d765-4919-90f4-b9ffc0867152 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.301439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294a7b1-c4e5-49d1-8c8b-f6c7e02527e9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.316111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.316838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.317119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.317393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.318147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:43.318452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.320441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.333930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 189/365] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.334800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.358282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.359294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.359743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.360299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.361824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:43.362305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.364001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.374403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 177/366] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.375665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.458372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727f164-db65-4015-a688-c1cd9ad2ec4a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.493220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.493888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.494170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.494728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.495571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:43.495886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.497375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.497505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:43.503758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 190/367] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.504593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.505779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c99ad-dd42-46a0-bd48-f11817d30230 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.525856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:43.554776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.555773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.556169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.556634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.557583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:43.557993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.559595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.566538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 178/368] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.573847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.681333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af893ae-cf43-4d2d-bd70-e7e305690d32 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.732592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0ba36-cbc7-4a4a-9f8a-104eefa5a80a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.755668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.756503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.756795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.757067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.772368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:43.783105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:43.783997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:43.784818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:43.785421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.785421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.785421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.785421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] PATH_INFO: `/v3/users/aebca333fb48460292a46067c8ae4e56` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:43.786982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] RBAC: Authorizing `identity:get_user(user_id=aebca333fb48460292a46067c8ae4e56)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:43.787251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 191/369] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:43.788174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.788866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:43.790699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 179/370] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/users/aebca333fb48460292a46067c8ae4e56 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:43.798481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:43.884995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:43.896924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21dc47-494d-4006-a13f-fde6edbfefd0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:43.902178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:43.934722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:43.935743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:43.936238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:43.936725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.012038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.014427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:44.077388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9157cd-ec2c-4db6-b2b3-713ac02acec0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:44.123013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:44.126857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:44.127537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:44.127818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:44.128127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.128967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] RBAC: Adding query filter params (role.id=a51e4cf245274a1c8bf99cf4b534aa86, user.id=aebca333fb48460292a46067c8ae4e56, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:44.129406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.130886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:44.159981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 180/371] 10.222.0.18 () {56 vars in 1308 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/role_assignments?user.id=aebca333fb48460292a46067c8ae4e56&scope.system=all&role.id=a51e4cf245274a1c8bf99cf4b534aa86 => generated 510 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:44.161162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:44.181363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 192/372] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:44.185273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:44.310108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42584dbe-ede8-4af9-8a97-7a4f05ba654f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:44.313944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:44.331020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888014d-10dd-4860-9583-26983d4470f7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:44.352698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:44.353811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:44.354097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:44.354369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.357474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.358974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:44.360804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 193/373] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:44 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:44.367613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:44.423281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:44.423973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:44.424255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:44.428504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.428504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:44.428504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.428504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:44.445514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 181/374] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:44.451688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:44.455281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:44.582206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a7584-1367-4367-bda7-ddf3635e7b4c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:44.634241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539291d-5c91-47a5-a42f-bb44411086d8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:44.682270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:44.682898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:44.683181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:44.683450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.685168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:44.686573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:44.687044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:44.687519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.688936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.690647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:44.692856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 194/375] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:44 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:44.699442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:44.721570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:44.822300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bca5d7-3281-4b30-b66c-caa630784330 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:44.860907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:44.867906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:44.869027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:44.869950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:44.870483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:44.871578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:44.872086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.874102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:44.885894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 195/376] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:44 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:44.919165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:44.920710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:45.072555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 182/377] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:45.078317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:45.200357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a50b2a-426a-4e8d-aa91-b8c08f6bc2e4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:45.241952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:45.243237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:45.243723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:45.244186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] PATH_INFO: `/v3/projects/7cee36c3beac431ba01428ee854cc3a6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:45.245586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] RBAC: Authorizing `identity:get_project(project_id=7cee36c3beac431ba01428ee854cc3a6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:45.247239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:45.249506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 196/378] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:45 2022] GET /identity/v3/projects/7cee36c3beac431ba01428ee854cc3a6 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:45.254877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:45.317077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:45.382144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdf910-c65a-4ec0-be41-af842cf3a9d8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:45.447331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19473a8a-9b4d-4b35-ac34-f7b926d58f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:45.448267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473a8a-9b4d-4b35-ac34-f7b926d58f7f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:45.448577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473a8a-9b4d-4b35-ac34-f7b926d58f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:45.448865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19473a8a-9b4d-4b35-ac34-f7b926d58f7f None admin] PATH_INFO: `/v3/groups/1a74c4c5877e46fd9cf34bf3ee41d988` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:45.455304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19473a8a-9b4d-4b35-ac34-f7b926d58f7f None admin] RBAC: Authorizing `identity:get_group(group_id=1a74c4c5877e46fd9cf34bf3ee41d988)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:45.456814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19473a8a-9b4d-4b35-ac34-f7b926d58f7f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:45.458809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 183/379] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:45 2022] GET /identity/v3/groups/1a74c4c5877e46fd9cf34bf3ee41d988 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:45.465546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:45.515782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:45.597017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15118c98-9c92-4a8a-91f5-4338cfb3e929 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:45.604623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07db3da-c4cd-4b21-9850-c894ebba6904 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:45.604906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07db3da-c4cd-4b21-9850-c894ebba6904 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:45.605449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07db3da-c4cd-4b21-9850-c894ebba6904 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:45.609486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 184/380] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:45.616507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:45.617318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:45.617819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:45.652738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:45.654722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:45.658522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:45.659522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:45.660023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:45.660513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:45.661591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] RBAC: Adding query filter params (group.id=1a74c4c5877e46fd9cf34bf3ee41d988, role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=7cee36c3beac431ba01428ee854cc3a6) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:45.662123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:45.664867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:45.681398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 197/381] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:45 2022] GET /identity/v3/role_assignments?group.id=1a74c4c5877e46fd9cf34bf3ee41d988&scope.project.id=7cee36c3beac431ba01428ee854cc3a6&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:45.762309 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 185/382] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:45.803099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:45.909739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:45.919862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95102877-ddec-4c52-be3f-999f86c2c545 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:45.961993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd268232-98f8-42e9-a272-8304ec7fee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:45.962808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd268232-98f8-42e9-a272-8304ec7fee3a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:45.963090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd268232-98f8-42e9-a272-8304ec7fee3a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:45.963365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd268232-98f8-42e9-a272-8304ec7fee3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:45.973987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd268232-98f8-42e9-a272-8304ec7fee3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-dd268232-98f8-42e9-a272-8304ec7fee3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:45.981681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:45.982544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:45.983355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 198/383] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:45.990375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.031524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b3e9-45a2-47da-8a41-0d37f6bb30e4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.032152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b3e9-45a2-47da-8a41-0d37f6bb30e4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.032665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b3e9-45a2-47da-8a41-0d37f6bb30e4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.034543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 199/384] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:46.040784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.041326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.041799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.061150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:46.062674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:46.067727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.174180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 200/385] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:46.182846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ab032-cf3c-4776-aea4-edb981d7d311 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.203247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.256034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.256767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.257051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.257327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.258192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:46.258573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.260098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6f079-cf20-4c54-93ec-3561f22c3eb3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.276870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 186/386] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:46.278420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c472f8-1bb5-4463-9865-76ef604d853e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.278710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c472f8-1bb5-4463-9865-76ef604d853e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.278989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c472f8-1bb5-4463-9865-76ef604d853e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.280634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 187/387] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:46.282990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c472f8-1bb5-4463-9865-76ef604d853e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.294251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.304322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009a385-c7c5-45eb-a963-e7e555c44bf1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.341290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4690d0-f5b3-4a0f-b30d-778f60b6d54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.342202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4690d0-f5b3-4a0f-b30d-778f60b6d54d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.342546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4690d0-f5b3-4a0f-b30d-778f60b6d54d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.342888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4690d0-f5b3-4a0f-b30d-778f60b6d54d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.355925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4690d0-f5b3-4a0f-b30d-778f60b6d54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4e4690d0-f5b3-4a0f-b30d-778f60b6d54d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:46.364786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:46.365667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:46.366450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 201/388] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:46.370206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.370206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.370206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.387498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:46.388889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:46.403477 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c472f8-1bb5-4463-9865-76ef604d853e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.410206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.443260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.444236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.444564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.445207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.446473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.448098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.450113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 188/389] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:46.451050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.472069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 202/390] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:46.473167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.553482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.557444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f8186-5a4a-4204-b6e8-eba77c2b5571 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.572869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af450-39bd-408f-95b2-c1fbc49dc147 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.594682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.595587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.596013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.596456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.597474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:46.598018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.599547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.609095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 189/391] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:46.610189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.610317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.611253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.611638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.611976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.613457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.615569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.616861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 203/392] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:46.617771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.661226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.720222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21e0e4-57f6-4ba2-bedd-7316dc560f75 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.722616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089d86-912e-4742-a30d-3f3740f5b73d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.754327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414427c-c725-4261-9109-635f89d755ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.755298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414427c-c725-4261-9109-635f89d755ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.755639 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414427c-c725-4261-9109-635f89d755ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.756007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414427c-c725-4261-9109-635f89d755ca None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.757250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414427c-c725-4261-9109-635f89d755ca None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.758828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414427c-c725-4261-9109-635f89d755ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.759960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.760959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 204/393] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:46.761331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.761864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.761966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414427c-c725-4261-9109-635f89d755ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.762426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.774150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:46.779623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:46.784214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:46.785244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:46.786078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:46.788928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 190/394] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:46.791354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.885024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414427c-c725-4261-9109-635f89d755ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.897082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:46.908235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1146a1-5f60-440c-856c-5a60a2b47fe4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:46.932896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.934422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.935151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.936036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.939147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a0066d332c04a8a9b259f8e09b1012e, group_id=4e2d8d73a3534ec7a1c35e288e5a00b7, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.941415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.947713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:46.948739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:46.949250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:46.949517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:46.950755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:46.952395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:46.954892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 191/395] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:46.955818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:46.967340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 205/396] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jul 21 05:26:46 2022] PUT /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:46.967340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:47.113856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:47.159774 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe2071-5be2-403f-95be-5bb3cbc21aa4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:47.173967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b047b2-fadf-4087-86d2-5f0ae0044709 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:47.211548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291b0f3-7cc0-4823-969f-85ceea35e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:47.213270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b0f3-7cc0-4823-969f-85ceea35e622 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.213805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b0f3-7cc0-4823-969f-85ceea35e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.214318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291b0f3-7cc0-4823-969f-85ceea35e622 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.216014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:47.216806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.217134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291b0f3-7cc0-4823-969f-85ceea35e622 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a, group_id=4e2d8d73a3534ec7a1c35e288e5a00b7, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:47.217246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.217486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.218331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:47.218698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:47.219437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291b0f3-7cc0-4823-969f-85ceea35e622 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:47.220192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:47.231065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 192/397] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:47.236178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 206/398] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jul 21 05:26:46 2022] PUT /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:47.237346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:47.268169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:47.345367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde8a52-6181-41ae-97e4-ecc4dd6286ef None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.345703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde8a52-6181-41ae-97e4-ecc4dd6286ef None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.345936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde8a52-6181-41ae-97e4-ecc4dd6286ef None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.347559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 207/399] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:26:47.352924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.353206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.353478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.354115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd23cc-acc2-489c-b8eb-b20f7f754aca None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:47.373838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:47.374962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:47.400283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:47.401592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.402131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.402408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.404238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:47.406082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:47.408121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 193/400] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:47 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:47.417594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:47.480303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 208/401] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:47.514467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:47.540721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:47.562684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58785f63-fa83-4539-9ce7-277879fa7edd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:47.628775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:47.629573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.629850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.630123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.635562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:47.636551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:47.638949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:47.644112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 194/402] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:47 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:47.650053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:47.738609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca9e03-fd85-40a6-92c0-b2e41ce3a037 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:47.761506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13028e-4f38-4ca6-9bb5-9a4c2df66ad1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:47.796398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:47.797330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.797636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.797885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.806199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a0066d332c04a8a9b259f8e09b1012e, group_id=4e2d8d73a3534ec7a1c35e288e5a00b7, role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:47.807674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:47.813489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:47.814318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:47.814597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:47.814868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:47.827935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:47.840326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 195/403] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jul 21 05:26:47 2022] PUT /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:47.843611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:47.844520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:47.845328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:47.849430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 209/404] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:47.855453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:47.894559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:47.996576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e650ec-b227-42b4-b80e-1a3d32b3f0e5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:48.039627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:48.040323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.040638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.040914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.041677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:48.041986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:48.043378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:48.053371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 196/405] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:48.059194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:48.165901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94486df0-7f19-46bd-b869-9100adc679f1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:48.192620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:48.204031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4e67-5e22-40fe-a598-b3ec9402be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:48.204936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4e67-5e22-40fe-a598-b3ec9402be0e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.205220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4e67-5e22-40fe-a598-b3ec9402be0e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.205492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4e67-5e22-40fe-a598-b3ec9402be0e None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.206665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d4e67-5e22-40fe-a598-b3ec9402be0e None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:48.208135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d4e67-5e22-40fe-a598-b3ec9402be0e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:48.210195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 210/406] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:48 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:48.215954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:48.227527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166912-d65f-4c7d-b396-ee77072064ff None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.227807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166912-d65f-4c7d-b396-ee77072064ff None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.229938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166912-d65f-4c7d-b396-ee77072064ff None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.231750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 211/407] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:48.237400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.237685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.237952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.265959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:48.267147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:48.357002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:48.393181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 212/408] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:48.393994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770d71-d38e-43c5-8d13-8d3caa33e5e8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:48.426294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:48.465754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:48.466641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.466921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.467194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.470434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:48.471899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:48.476947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 197/409] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:48 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:48.500819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:48.574216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222272-b5ca-4583-a28a-53db83b7d0b7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:48.598851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:48.611232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:48.612097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.612379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.612689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.624515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:48.632570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:48.633567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:48.634925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 213/410] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:48.645695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:48.710570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9780e-4d6c-4f1c-bedc-58876d6a58e3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:48.748292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc683-3c24-4a0e-9a58-bf8625d67f47 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:48.775209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:48.775209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.775209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.775209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.777701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a, group_id=4e2d8d73a3534ec7a1c35e288e5a00b7, role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:48.779444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:48.788505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:48.788505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:48.788505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:48.788505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:48.788849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:48.788849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:48.788849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:48.795147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 214/411] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:48.805511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:48.815922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 198/412] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jul 21 05:26:48 2022] PUT /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a/groups/4e2d8d73a3534ec7a1c35e288e5a00b7/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:48.908972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:48.982192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db4f21-53be-49b1-ac48-04f4dc279944 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:49.045497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:49.046369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.046647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.046919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] PATH_INFO: `/v3/groups/1a74c4c5877e46fd9cf34bf3ee41d988` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.048087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] RBAC: Authorizing `identity:get_group(group_id=1a74c4c5877e46fd9cf34bf3ee41d988)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:49.049646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:49.051275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 215/413] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:48 2022] GET /identity/v3/groups/1a74c4c5877e46fd9cf34bf3ee41d988 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:49.057610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:49.071154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:49.171655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8859b8c-c87a-4beb-95a9-c87cb59c8d7e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:49.210402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfff50-e908-4aa1-bcc6-8f81211449bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:49.211567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfff50-e908-4aa1-bcc6-8f81211449bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.212040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfff50-e908-4aa1-bcc6-8f81211449bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.212455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfff50-e908-4aa1-bcc6-8f81211449bf None admin] PATH_INFO: `/v3/projects/7cee36c3beac431ba01428ee854cc3a6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.213833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfff50-e908-4aa1-bcc6-8f81211449bf None admin] RBAC: Authorizing `identity:get_project(project_id=7cee36c3beac431ba01428ee854cc3a6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:49.215489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfff50-e908-4aa1-bcc6-8f81211449bf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:49.217740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 199/414] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:49 2022] GET /identity/v3/projects/7cee36c3beac431ba01428ee854cc3a6 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:49.225530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:49.340803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f0b6-dd9b-41a3-a8aa-ed91adceea05 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:49.355731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:49.382557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdb017-513d-445a-9c87-ebffbd970cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:49.383827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdb017-513d-445a-9c87-ebffbd970cf0 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.384255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdb017-513d-445a-9c87-ebffbd970cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.384695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdb017-513d-445a-9c87-ebffbd970cf0 None admin] PATH_INFO: `/v3/projects/7cee36c3beac431ba01428ee854cc3a6/groups/1a74c4c5877e46fd9cf34bf3ee41d988/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.389763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdb017-513d-445a-9c87-ebffbd970cf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cee36c3beac431ba01428ee854cc3a6, group_id=1a74c4c5877e46fd9cf34bf3ee41d988, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:49.391403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdb017-513d-445a-9c87-ebffbd970cf0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:49.414795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 216/415] 10.222.0.18 () {58 vars in 1442 bytes} [Thu Jul 21 05:26:49 2022] PUT /identity/v3/projects/7cee36c3beac431ba01428ee854cc3a6/groups/1a74c4c5877e46fd9cf34bf3ee41d988/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:26:49.595812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368c1-fa52-428c-9c49-c12a63dcfdb1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.596165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368c1-fa52-428c-9c49-c12a63dcfdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.596875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936368c1-fa52-428c-9c49-c12a63dcfdb1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.598532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 200/416] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:49.604036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.604331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.604659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.626647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:49.627871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:49.646317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65934-d7db-4866-a194-e9013bfeaf04 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.646622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65934-d7db-4866-a194-e9013bfeaf04 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.646871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c65934-d7db-4866-a194-e9013bfeaf04 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.648497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 201/417] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:49.654011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.654288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.654570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.672066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:49.673307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:49.714467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 217/418] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:49.738486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:49.764022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 202/419] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:49.791379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:49.800598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:49.858843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3762f91-ae45-44ff-b9a1-3c9916362e81 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:49.866226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:49.925368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:49.926184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:49.926462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:49.926740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:49.944264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1989-89f4-4bed-afc7-efd5a71b04de None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:49.945451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:49.954507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:49.955364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:49.956135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:49.958113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 218/420] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:49.961668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.011550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.012368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.012679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.012949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.035258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:50.046577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:50.048722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:50.050602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 203/421] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:50.056088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.144194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba93fe-456b-4fe5-87bd-1ff2a732232b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:50.173806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:50.205208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.205890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.206169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.206442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.207198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:50.207503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:50.211945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:50.225412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 219/422] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:50.231067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.246453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733e8c7-15b3-41c5-9652-db9869619a5c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:50.260890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:50.336802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3088884-72e4-4f81-b39d-f1beac7f71b7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:50.353182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.353875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.354161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.354465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.355198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:50.355533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:50.356939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:50.371455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f42925-0e84-455c-b7f4-af3c178772d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.372113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f42925-0e84-455c-b7f4-af3c178772d0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.372389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f42925-0e84-455c-b7f4-af3c178772d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.372701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f42925-0e84-455c-b7f4-af3c178772d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.375364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 204/423] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:50.397958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.523342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f42925-0e84-455c-b7f4-af3c178772d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:50.524944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f42925-0e84-455c-b7f4-af3c178772d0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:50.528243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444259d-826b-4e46-93bb-f40fd418047c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:50.558552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:50.569237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b04851-22db-4e1a-97e2-067d7c5d6fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.570399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b04851-22db-4e1a-97e2-067d7c5d6fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.570678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b04851-22db-4e1a-97e2-067d7c5d6fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.571319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b04851-22db-4e1a-97e2-067d7c5d6fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.574829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:50.646437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b04851-22db-4e1a-97e2-067d7c5d6fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:50.648415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b04851-22db-4e1a-97e2-067d7c5d6fc8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:50.655589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 220/424] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:50.657059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf52dd-b3cf-4634-b11d-998ac202ddd7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.657393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf52dd-b3cf-4634-b11d-998ac202ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.657734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf52dd-b3cf-4634-b11d-998ac202ddd7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.663770 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 221/425] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:50.664634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf52dd-b3cf-4634-b11d-998ac202ddd7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.765795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 205/426] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:26:50.767194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.767542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.767876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.779481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf52dd-b3cf-4634-b11d-998ac202ddd7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:50.785285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:50.786637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:50.805270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:50.814752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:50.815642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.816545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.816826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.817092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.818351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:50.820180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:50.822291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 222/427] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:50.823198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.872864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 206/428] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:50.873777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.922539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e966c7-8a87-4dd8-90bf-a1deb4762aaf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:50.958827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:50.959699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:50.959976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:50.960404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:50.962157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:50.963884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:50.966553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 223/429] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:50.972308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:50.996856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaac502-b2ad-4db7-a4a8-70bcd65e99ef None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.032546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.033422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.033701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.033972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.035292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.036774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.043844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 207/430] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:51.044805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.045528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.091331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a09405-4656-4284-b5b2-692cd7c4f1c4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.092405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.136388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.137333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.137614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.137887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.155844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:51.156178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490cde5-480e-4283-aa08-f9f769f965e7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:51.166086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:51.167871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:51.168716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 224/431] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:51.169431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.199378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.200310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.200719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.201058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.202302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.203861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.205657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 208/432] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:51.206522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.284617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffad13a-60d3-4c76-9a4e-31fcca617655 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.305858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.313612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.318736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.320035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.320375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.320687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.321583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:51.321887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.322132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0907-01a6-481b-93e5-164c2e38521f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.323328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.340842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 225/433] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:51.340842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.380567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.381410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.381790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.382169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.383057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:51.383544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.385692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbff9-a567-4f36-b004-b673c6dddf3b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.400684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 209/434] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:51.402319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfca0-f80e-4487-bcb3-1444e4d3a2c9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.402610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfca0-f80e-4487-bcb3-1444e4d3a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.402932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfca0-f80e-4487-bcb3-1444e4d3a2c9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.404777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 210/435] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:51.407882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfca0-f80e-4487-bcb3-1444e4d3a2c9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.459272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e58b58-1934-42cf-8629-4dce7c40492a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.497285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.498410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.498869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.499328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.500455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=5cf5c09e27ba4efeb3ffdc17f4a11668, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:51.501054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.502769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d20bc-1eaa-4cfd-85a7-cc098b01113d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.510962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 226/436] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:51.512279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.512552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.512824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.535236 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:51.536959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:51.551551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfca0-f80e-4487-bcb3-1444e4d3a2c9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.592396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.593120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.593396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.593669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.594138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.620705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 227/437] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:51.629981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.656616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.682560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.683997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.780924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc107b5-0ae1-4085-8f54-5525819212a3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.819377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.820591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.820872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.821310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.821733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 211/438] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:51.828299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.837228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:51.845457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:51.846377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:51.847373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 228/439] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:26:51.853140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:51.901423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.909855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:51.957129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e8b3-6908-4201-8877-bc265da95b10 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.973469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52459-be2f-4713-997f-76d19b753d16 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:51.989968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14942614-d756-4e52-858a-af9bcb84185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:51.990842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14942614-d756-4e52-858a-af9bcb84185f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.991125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14942614-d756-4e52-858a-af9bcb84185f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.991396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14942614-d756-4e52-858a-af9bcb84185f None admin] PATH_INFO: `/v3/projects/9a0066d332c04a8a9b259f8e09b1012e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.992593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14942614-d756-4e52-858a-af9bcb84185f None admin] RBAC: Authorizing `identity:get_project(project_id=9a0066d332c04a8a9b259f8e09b1012e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:51.994076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14942614-d756-4e52-858a-af9bcb84185f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:51.995773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 212/440] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/projects/9a0066d332c04a8a9b259f8e09b1012e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:51.996982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdc0a-f4ff-4987-952a-54c0367d5ebf None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:51.997261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdc0a-f4ff-4987-952a-54c0367d5ebf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:51.997531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bdc0a-f4ff-4987-952a-54c0367d5ebf None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:51.998996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 213/441] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:52.001227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bdc0a-f4ff-4987-952a-54c0367d5ebf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.007828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.008613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.008901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.009179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.009936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:52.010245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.011672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c9b2b-7c5e-4bdc-b447-99e4ce84b4ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.020027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 229/442] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:52.021372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.021665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.021940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.038988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:52.040205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:52.112995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bdc0a-f4ff-4987-952a-54c0367d5ebf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.116596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 230/443] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:52.117471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.136366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.149436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.150315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.150597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.150872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.152154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.153672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.160936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 214/444] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:52.160936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.161321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.225000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5af1-6b9d-4b51-8522-f80f226a8e83 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.257468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.258120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.258401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.258731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.259698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8189-f9e6-4756-aaee-1f46c467b7c8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.293109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.293890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.294160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.294428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.305510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:52.313055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:52.314362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 215/445] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:52.315191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.328859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.330341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.359511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.368365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.416994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d25ab6-1a7d-49f4-b2dd-f8a1f395656e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.431610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 231/446] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:26:52.432462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.451416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.452159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.452444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.452757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.453594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=9a0066d332c04a8a9b259f8e09b1012e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:52.453905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.455359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.461427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 216/447] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=9a0066d332c04a8a9b259f8e09b1012e&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:52.462236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.538937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1a67a-eb8f-4c84-be3d-c7d228136af7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.572765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.575354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03576133-3c0f-4801-8d10-32f486135d9e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.578543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.579314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.579738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.580063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.581116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:52.581621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.583266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.593112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 232/448] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:52.599108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.599921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.620449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.621514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.621641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.621904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] PATH_INFO: `/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.623099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] RBAC: Authorizing `identity:get_project(project_id=4f5ef2a6466f4004a1ec00c20e9ebb3a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.624584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.627673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 217/449] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/projects/4f5ef2a6466f4004a1ec00c20e9ebb3a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:52.631784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.728404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010214-36dc-4990-bbf3-06a1bdfd495b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.753085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d435ba-0468-4515-9930-e7a173891fdf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.775044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.775708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.775994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.776270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.792413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.793310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.793589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.793862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] PATH_INFO: `/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.795882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] RBAC: Authorizing `identity:get_group(group_id=4e2d8d73a3534ec7a1c35e288e5a00b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.797372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.800452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 218/450] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/groups/4e2d8d73a3534ec7a1c35e288e5a00b7 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:52.805659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.848889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.858418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.860487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.878280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:52.934510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554efa-ff58-49a7-b929-2ae9953c4b31 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:52.971117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:52.971784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:52.972072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:52.972346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:52.973208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] RBAC: Adding query filter params (group.id=4e2d8d73a3534ec7a1c35e288e5a00b7, role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:52.973522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:52.974962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:52.975478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 233/451] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:26:52.981487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:52.995896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 219/452] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/role_assignments?group.id=4e2d8d73a3534ec7a1c35e288e5a00b7&scope.project.id=4f5ef2a6466f4004a1ec00c20e9ebb3a&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:53.079609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:53.087335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54feea-a7ea-4cfa-9af1-4edd10c986b6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:53.124101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:53.124931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:53.125210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:53.125481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] PATH_INFO: `/v3/projects/7cee36c3beac431ba01428ee854cc3a6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:53.126688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] RBAC: Authorizing `identity:get_project(project_id=7cee36c3beac431ba01428ee854cc3a6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:53.128171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:53.129884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 234/453] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:26:52 2022] GET /identity/v3/projects/7cee36c3beac431ba01428ee854cc3a6 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:26:53.135650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:53.241761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30f28-72ce-420b-97c5-c9ccb3ffdff4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:53.258022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:53.276431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d68f60-ad7e-4f9a-8c0d-704c24051b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:53.277342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68f60-ad7e-4f9a-8c0d-704c24051b65 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:53.277626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68f60-ad7e-4f9a-8c0d-704c24051b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:53.277904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d68f60-ad7e-4f9a-8c0d-704c24051b65 None admin] PATH_INFO: `/v3/groups/1a74c4c5877e46fd9cf34bf3ee41d988` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:53.279094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d68f60-ad7e-4f9a-8c0d-704c24051b65 None admin] RBAC: Authorizing `identity:get_group(group_id=1a74c4c5877e46fd9cf34bf3ee41d988)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:53.280568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d68f60-ad7e-4f9a-8c0d-704c24051b65 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:53.282195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 220/454] 10.222.0.18 () {56 vars in 1180 bytes} [Thu Jul 21 05:26:53 2022] GET /identity/v3/groups/1a74c4c5877e46fd9cf34bf3ee41d988 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:53.288439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:53.388880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef9f5-6b90-48ec-a4c9-a4c5028b2c0a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:53.426270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:53.427365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:53.427873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:53.428388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:53.430052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] RBAC: Adding query filter params (group.id=1a74c4c5877e46fd9cf34bf3ee41d988, role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=7cee36c3beac431ba01428ee854cc3a6) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:53.430646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:53.432198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237624aa-a873-475f-8307-cd050f4f3fbc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:53.438682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 235/455] 10.222.0.18 () {56 vars in 1376 bytes} [Thu Jul 21 05:26:53 2022] GET /identity/v3/role_assignments?group.id=1a74c4c5877e46fd9cf34bf3ee41d988&scope.project.id=7cee36c3beac431ba01428ee854cc3a6&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:55.866160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9fec4-418e-49c5-b005-e99249bac0e1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:55.866704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9fec4-418e-49c5-b005-e99249bac0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:55.866704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9fec4-418e-49c5-b005-e99249bac0e1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:55.868378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 221/456] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:55.873637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:55.874114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:55.874191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:55.901555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:55.902760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:55.928054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:55.994858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 236/457] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:56.032748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9fec4-418e-49c5-b005-e99249bac0e1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:56.192496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9fec4-418e-49c5-b005-e99249bac0e1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:56.238263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:56.239110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.239393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.239666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.257593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:56.259126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2bd0d924-03ea-4f7c-a07b-a9c3fd55adec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:26:56.281091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:56.282011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:56.282869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:26:56.282869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:26:56.282869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:56.282869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:56.282869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 222/458] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:56.288224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:56.346164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8aa9-c9aa-4057-ac71-6d256ec4721b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.346445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8aa9-c9aa-4057-ac71-6d256ec4721b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.346879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b8aa9-c9aa-4057-ac71-6d256ec4721b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.348401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 223/459] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:26:56.359654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff170f6-2977-4e73-b941-b01ac9ede5a0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.360237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff170f6-2977-4e73-b941-b01ac9ede5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.360771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff170f6-2977-4e73-b941-b01ac9ede5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.389459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4ff170f6-2977-4e73-b941-b01ac9ede5a0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:56.391145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4ff170f6-2977-4e73-b941-b01ac9ede5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:56.453849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:56.467224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abf6b7-f380-4639-a993-e19818de5423 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:56.502686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 224/460] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:56.504556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e8f17-426d-4ad3-bb36-09f87a9be369 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.504977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e8f17-426d-4ad3-bb36-09f87a9be369 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.505474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e8f17-426d-4ad3-bb36-09f87a9be369 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.507773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:56.508767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.509251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.509799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.510823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:56.511327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:56.512383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 225/461] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:56.513211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75460d93-d8d2-45f7-ab13-1571f775fa70 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:56.513985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.514269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.514545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.531485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:56.532751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:56.536499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 237/462] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:56.538070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a14143-8765-46fc-b420-fa0909b11e2a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.538560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a14143-8765-46fc-b420-fa0909b11e2a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.539054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a14143-8765-46fc-b420-fa0909b11e2a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.541310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 238/463] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:56.542207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a14143-8765-46fc-b420-fa0909b11e2a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:56.566466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:56.602713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 226/464] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:56.603833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:56.664445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a14143-8765-46fc-b420-fa0909b11e2a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:56.701368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:56.702629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.703051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.703326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.713065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:56.715154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:56.717642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:56.719160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fb11-ea54-4e88-861a-8d758eb8826f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8ea11885-d7af-405f-91c8-a1ed50666749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:26:56.739166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:56.740128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:56.741044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:26:56.741044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:26:56.741044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:56.741044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:56.741044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 239/465] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:56.741955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.742277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.742457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.759518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:56.759893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:56.760614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.760838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:56.760936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.761154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:56.761860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:56.763303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:56.785041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 227/466] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:56 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:56.786167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:56.857172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:56.868635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 240/467] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:56.869886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:56.950010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261be1-0c86-4f3a-ac03-a7d01cc48d9a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:56.987218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:56.988312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:56.988774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:56.989107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.001557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.002646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.006938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e4e0b-52fe-49a4-b2a3-65599e7a9433 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:26:57.022869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:57.023911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:57.024953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:26:57.024953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:26:57.024953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:57.024953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.025495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 228/468] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:57.025846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.030225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:57.059222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.059901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.060188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.060448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.061279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:57.062597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.062990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.075599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 241/469] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:57.076149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.168425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:57.191511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf95d-e9b8-4c24-9b85-c1e9877d59d9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.237078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c71da-4a9f-4d18-89eb-83eee8824f6a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.239076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.240510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.240510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.240510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.251752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.253237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:26:57.271088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:57.271947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:57.273565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:26:57.273565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:26:57.273565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:26:57.273565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.273565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 229/470] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:57.273565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.282094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.283331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.283609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.283878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.284997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:57.285300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.287009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010434-641e-448f-8432-dbf0be8bd00d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.303600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 242/471] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:57.303600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd79f-096f-4d4e-8035-196ce7d88254 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.303600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd79f-096f-4d4e-8035-196ce7d88254 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.303600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd79f-096f-4d4e-8035-196ce7d88254 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.303600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 243/472] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:57.303600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dd79f-096f-4d4e-8035-196ce7d88254 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.338725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:57.386200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c2678-b196-4d9a-a5d7-be66cf3a4178 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.411700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dd79f-096f-4d4e-8035-196ce7d88254 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.431193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.432101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.432216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.432388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.432855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:57.433156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.434612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.452161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.452874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.453154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.453427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.454156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:57.454484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.460856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 230/473] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:57 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:57.460856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.461152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4bb9-2210-478b-b504-b6f28d3b2b85 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.470179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 244/474] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:57.471716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.472002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.472937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.495939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:57.497801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:57.593291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 245/475] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:26:57.594201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.603603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0dc7-372e-4df8-ae36-30ccb64ad9b1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.630010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:57.658795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.659506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.659810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.660086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.661364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.663237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.686901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 231/476] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:57 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:57.687530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:57.752096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a996f7-cca9-4a6e-ad13-e8448b4db386 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.763459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:57.795144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.795726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.796002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.796276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.797054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.798532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.832504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 246/477] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:26:57 2022] POST /identity/v3/users => generated 249 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:26:57.846620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb917d-2580-4655-b92f-2bcd2df1c014 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:57.889243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:57.890026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:57.890313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:57.890586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:57.891409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:57.892902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:57.900570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.sql.core [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 05:26:57.900570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 05:26:57.900570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [parameters: {'id': 'dd276d29d27540ad92f7fa6f41a98438', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 05:26:57.900570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80393) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 21 05:26:57.918435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 05:26:57.919351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application yield resource Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise self.value Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application session.commit() Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 05:26:57.920262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.flush() Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application compat.raise_( Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 05:26:57.921132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 05:26:57.922028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 05:26:57.922828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [parameters: {'id': 'dd276d29d27540ad92f7fa6f41a98438', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:57.927785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 05:26:57.929831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:26:57.931781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 232/478] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jul 21 05:26:57 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:57.931914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:58.058007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf94a7-0816-41f8-b16f-5b40e0a0a22e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:58.096721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4198c8a-3f78-4aee-9bb8-e7ab1185d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:58.097617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4198c8a-3f78-4aee-9bb8-e7ab1185d973 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:58.097893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4198c8a-3f78-4aee-9bb8-e7ab1185d973 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:58.098214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4198c8a-3f78-4aee-9bb8-e7ab1185d973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:58.110847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4198c8a-3f78-4aee-9bb8-e7ab1185d973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b4198c8a-3f78-4aee-9bb8-e7ab1185d973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:58.118979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:58.119882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:58.120697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 247/479] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:26:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:58.126531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:58.161748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:58.233855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c072-588a-413d-acdd-bd7d1ea23406 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:58.268912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:58.269592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:58.269903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:58.270185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:58.270943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:58.271249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:58.272656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479720ab-1025-4a41-bf3e-48c232d9f4a6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:58.281533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 233/480] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:26:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:59.038703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6446-e904-4285-b481-42082f89f18b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.039087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6446-e904-4285-b481-42082f89f18b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.039258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e6446-e904-4285-b481-42082f89f18b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:59.040954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 248/481] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:59.046364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.046659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.046938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:59.065964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:59.067163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:59.154847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 234/482] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:26:59.190761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e6446-e904-4285-b481-42082f89f18b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:59.237266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:59.337158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e6446-e904-4285-b481-42082f89f18b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:59.388084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:59.388919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.389196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.389467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:59.413330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:26:59.421889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:26:59.422916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:26:59.423727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:26:59.427576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 249/483] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:26:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:26:59.430779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:59.476879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:59.662644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6ef67-21da-42c2-ab92-8af04e77d827 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:59.724217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:59.724921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.725204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.725476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:59.726291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:26:59.726599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:26:59.728053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33369c51-5f68-4cc7-aa04-f8363518b082 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:26:59.739743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 235/484] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:26:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:26:59.749566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:26:59.886005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:26:59.904574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe09b4-e8b1-4a29-b092-15ce42166ed6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:26:59.910299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d15b8-3526-42fd-851f-43616d6e738a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.910582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d15b8-3526-42fd-851f-43616d6e738a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.910860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d15b8-3526-42fd-851f-43616d6e738a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:59.912507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 236/485] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:26:59.922997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.923246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.924511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:26:59.950927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:26:59.952655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:26:59.979572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:26:59.981525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:26:59.981810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:26:59.982091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.001359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:00.002873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:00.022274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:00.023162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:00.024771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:00.024771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:00.024771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:00.024771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:00.024771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 250/486] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:00.028975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.096017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 237/487] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:27:00.126634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.156857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:00.206787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f21b34-5eec-4ce1-86c0-b3ca3ad43634 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.243473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.244150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.244433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.244734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.245465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:00.245977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:00.247444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:00.250067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:00.264108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 251/488] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:00.269281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.350894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8be23-3bad-470a-8dd7-08e09716278c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.409638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8508f3-e0c6-4add-99de-d5b0a6d091a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.410716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8508f3-e0c6-4add-99de-d5b0a6d091a0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.411007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8508f3-e0c6-4add-99de-d5b0a6d091a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.411278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8508f3-e0c6-4add-99de-d5b0a6d091a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.424815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8508f3-e0c6-4add-99de-d5b0a6d091a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:00.432379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86d11c-d1b6-4b4c-8b07-ab6facbd7cb7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ee8508f3-e0c6-4add-99de-d5b0a6d091a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:00.434342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:00.435202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:00.436395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 238/489] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:00.437278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ac11-39d4-4fa4-a469-5cadff2dd37c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.437507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ac11-39d4-4fa4-a469-5cadff2dd37c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.437675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ac11-39d4-4fa4-a469-5cadff2dd37c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.440041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 239/490] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:00.441205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ac11-39d4-4fa4-a469-5cadff2dd37c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.477442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.478215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.478476 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.478752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.487242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:00.488407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-77d8169a-715d-4aa1-8ff4-6e56df5dd8dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:00.505342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:00.506301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:00.507201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 252/491] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:00.508288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.508288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.508671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.526609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:00.527802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:00.539087 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:00.569955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ac11-39d4-4fa4-a469-5cadff2dd37c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.587252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:00.608354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 253/492] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:00.609321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.620490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.621844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.622335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.623050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.624347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:00.624899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:00.627210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5fc12-397b-447f-b0be-4a7c340523f6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:00.638771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 240/493] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:00.640784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4cf8-2590-4815-99a0-4b40ace765f9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.641441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4cf8-2590-4815-99a0-4b40ace765f9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.641915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c4cf8-2590-4815-99a0-4b40ace765f9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.643899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 241/494] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:00.644823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4cf8-2590-4815-99a0-4b40ace765f9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.719565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592d306-f073-482a-8b6d-0779480c58c7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.752075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c4cf8-2590-4815-99a0-4b40ace765f9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.757703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.758421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.758699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.758964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.760215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:00.760558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:00.762671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:00.786056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e2d4-4b21-45e0-a4f9-165449bf832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.786853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e2d4-4b21-45e0-a4f9-165449bf832e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.787131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e2d4-4b21-45e0-a4f9-165449bf832e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.787403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e2d4-4b21-45e0-a4f9-165449bf832e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.794632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:00.799658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e2d4-4b21-45e0-a4f9-165449bf832e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:00.808538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 254/495] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:00.808538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a5e5e2d4-4b21-45e0-a4f9-165449bf832e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:00.808794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:00.811185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 242/496] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:00.812004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.816569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.816569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.831854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:00.833063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:00.860928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:00.902800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 243/497] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:00.903693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:00.918282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053901d-5a6a-4787-bef3-222854a602ad None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:00.963881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:00.964719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:00.965001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:00.965275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:00.976786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:00.978335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:00.995932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:00.996860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:00.997714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:00.997714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:00.997714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:00.997714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:00.997714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 255/498] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:00.997987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.009418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98fea4-5824-49d7-b503-ced261a2418e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.034907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.043197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.043882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.044165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.044439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.091783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.097645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829d61-8397-4c2f-acf4-207fa2cc5e75 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.110937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.112408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.131296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.131966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.132250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.132552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.133324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:01.133657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.135038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eac6d-167c-4d46-a69d-96713bcd9423 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.143391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 256/499] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:01.144746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4884-80fd-4085-be3e-6f77bcbb54eb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.145036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4884-80fd-4085-be3e-6f77bcbb54eb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.145314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4884-80fd-4085-be3e-6f77bcbb54eb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.146675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 257/500] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:01.149226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a4884-80fd-4085-be3e-6f77bcbb54eb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.212051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 244/501] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:01.212783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.239393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.256119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a4884-80fd-4085-be3e-6f77bcbb54eb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.290133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.290931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.291196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.291457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.301456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:01.309007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b186f7-897d-4549-a81f-1f9c482c5da2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:01.309141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:01.309979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:01.310920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 258/502] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:01.311747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.329953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.346271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.346937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.347249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.347521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.348246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:01.348585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.349964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f35d1-16d2-4f0c-b1ee-b7881f97f763 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.361177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 245/503] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:01.362554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.363006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.363296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.378939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:01.380107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:01.408362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac67f7-c652-4d21-983a-e902db2dffb1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.443585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.444389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.445059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.445331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.448561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 246/504] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:01.449386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.461084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.463079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.471306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:01.480694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:01.481734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:01.482807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:01.482807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:01.482807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:01.482807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:01.482807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 259/505] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:01.482807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.549161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.554963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e4e85-78a7-4616-b03e-2372f378fa98 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.580049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2f0a4-19da-460f-8c18-6c9f88692e79 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.589816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.590616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.590898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.591173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.601350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.602841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.611783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.612433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.612749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.613023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.613771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:01.614083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.615474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:01.619968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:01.620838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:01.621675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:01.621675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:01.621675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:01.621675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:01.621675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 247/506] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:01.621942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.628038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 260/507] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:01.628754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.692556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.723222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2feac6-fcd4-417b-abbe-5afb8639ac46 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.726124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d9210-4709-4384-aa9e-d79bf49f6381 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.754384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.758360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.759183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.759464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.759736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.760199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.761023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.761301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.761571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.767163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.768643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.772364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.773845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:01.783694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:01.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:01.785488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 248/508] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:01.786031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:01.791120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:01.792096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:01.793012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:01.793012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:01.793012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:01.793012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:01.793012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 261/509] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:01.793268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.890249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af3a30-0dbb-42ca-8237-56d967e4a4e0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.892360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16617-ac3e-4378-bed2-4637b144d645 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:01.920235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:01.925116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.925783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.926066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.926282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:01.926386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.926947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:01.927045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:01.927231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:01.927360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.927509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:01.928231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:01.928562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:01.928805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.929934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:01.940169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 262/510] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:01.941004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.946921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 249/511] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:01.946921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:01.988456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.041533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1c5ef-5fbd-4013-b7a3-5a856aa49aa8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.047573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75130968-94b3-4a64-872e-d81a99e78947 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.073848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.074647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.074927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.075198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.080152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.080842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.081124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.081402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.082247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:02.082558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.084004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.085364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.086865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:02.103448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:02.104503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:02.105369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:02.105369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:02.105369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:02.105369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:02.105369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 263/512] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:02.105369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.122461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 250/513] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jul 21 05:27:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:02.123385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.173804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.206237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.212673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f603-6a8d-4dea-b232-58c317e82d06 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.224753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7203a-2ca8-4027-9b9f-2f8907ac4dea None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.245543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.246280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.246627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.246958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.247743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:02.248121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.249626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.258344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.259154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.259426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.259692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.261454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 264/514] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:02.262233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.267634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.269217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:02.284301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:02.285481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:02.286567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:02.291573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 251/515] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:02.291573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.364829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117a320-0558-43ee-bab5-f3fd4c4b0344 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.389838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afcf1b-3225-42ab-b339-de760a57a4ca None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.397765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.398565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.398839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.398975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.399158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.406477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.407964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:02.422217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:02.423239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 265/516] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:02.424172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.430874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.431631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.431916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.432193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.433339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:02.433677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.435414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.442207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.447922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 252/517] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:02.448793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.527645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4859-8579-4d2e-989f-affde1e2f232 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.547010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f73f-f545-4505-9740-917b654e3267 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.561022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.561665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.561943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.562217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.581699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.582377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.582662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.582941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.583654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.585148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.604712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 253/518] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:27:02 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:02.605751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.633877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.654377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.655910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.674941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.724868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a4fe-c82d-4459-9c22-9d108f5f8bd0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.763718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.764973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.764973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.764973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.765953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 266/519] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:02.766125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:02.766542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.766652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.768250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.787151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 254/520] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:02.788261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.875995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f3cb9-05e7-4f2c-9688-6adcca011f2d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.880360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.893115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:02.902057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a7540-e300-47db-a702-9348fa61e195 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:02.911103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.911777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.912063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.912339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.913164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:02.913484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.914980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.933121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 267/521] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:02.933864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:02.944175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:02.945354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:02.945632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:02.945959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:02.954300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:02.955760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:02.970792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:02.971716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:02.972639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 255/522] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:02.973190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.043097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62bf8a-ae88-412a-93df-e8bd98a26744 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.077148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.078003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.078322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.078578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.086163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831d1b-fb0e-4663-aaf3-21b2c4a6e82d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.089161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.090933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:03.109047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:03.109925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:03.110871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:03.110871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:03.110871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:03.110871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:03.110871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 268/523] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:03.111124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.129601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.130256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.130536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.130814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.143403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.144302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.206491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.207943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.222452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6bfe2-5447-441e-845e-515d87c6c36c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.256950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.257712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.258087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.258513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.259421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=89e2cefbcf0449ff8fb8b695bba26dd3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:03.259796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.261353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.267136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 269/524] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/role_assignments?user.id=89e2cefbcf0449ff8fb8b695bba26dd3&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:03.267943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.336672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 256/525] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:03.338313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.388976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.403197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.415065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c481b6b-300d-446c-bae1-bd5ccdc397ac None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.459137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09537ee-2159-4e00-b730-8b7c03fa7a30 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.459438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.460224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.460664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.461043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.462143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:03.462669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.464216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.487138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 270/526] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:03.487138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.503189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.504272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.504853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.505229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.506322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:03.507130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.508866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.526958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 257/527] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:03.526958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.595916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4a2f-cba0-49d1-bc68-34a5e7e4336c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.631325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.632407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.632913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.633386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.648354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.650174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.661843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68de786-0d1f-4754-97ae-67be55a809f4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.663536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:03.669650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:03.670516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:03.671373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:03.671373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:03.671373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:03.671373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:03.673694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 271/528] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:03.674776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.678516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.703115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.704163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.704674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.705218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.778984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.780538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.810631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d3ead-9c43-48ac-aa22-a145c7935856 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:03.856463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:03.857463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:03.857823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:03.858167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:03.867179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:03.868745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:03.882931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:03.884029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 272/529] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:03.885181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.895499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 258/530] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:03.896895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:03.900381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:03.960649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.002611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10119a7-3bcb-4a93-a17b-771d4c16fe46 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.012904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d58cc-9245-4cd7-aabe-aacfdf2f0b26 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.040641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.041677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.042192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.042672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.043754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:04.044257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.046150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.048509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.049493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.049602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.049827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.050634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:04.050940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.052378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.060007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 273/531] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:04.061127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.071945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 259/532] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:04.072815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.136985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.174190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec80c-a3b0-4a73-a549-da0cd28eb89d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.179869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fce51a-a0dd-40c6-aa37-1ef80013b623 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.199344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.213484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.214881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.215365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.215837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.216708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.217563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.217848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.218121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.225406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.226993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.229330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.231102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:04.242427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:04.243316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:04.244201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 260/533] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:04.245208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:04.252151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:04.253045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:04.253906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:04.253906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:04.253906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:04.253906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:04.255919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 274/534] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:04.256926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.350780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885118-b88a-462f-8323-5cd8d9a2c649 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.371141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfda2fa-5039-4c58-b509-062f88ac85e6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.374665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.386915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.387702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.387964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.388240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.389197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=876f25e90653467bb67a7f406cc9a8b8) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:04.389510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.391068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.397157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 261/535] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/role_assignments?user.id=876f25e90653467bb67a7f406cc9a8b8&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:04.398101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.410984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.411953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.412388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.412832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.413813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:04.414420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.416270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.430816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 275/536] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:04.437125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.481203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.560169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fa6e2-ee29-4f19-911d-41348c725e7f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.571290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33dfba-8ff2-4c45-9082-ec69bbbf62e6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.607123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.607702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.607984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.608252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.609109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=535729140fea45e99aa556d85913ae08) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:04.609419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.610963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.617461 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 276/537] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/role_assignments?user.id=535729140fea45e99aa556d85913ae08&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:04.631576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.632281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.632591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.632865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.633653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:04.633968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.635399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a125-f9dc-46c9-a70b-c264df3f5cbf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.663891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 262/538] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:04.668986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:04.795063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50d782-2837-48a5-b4e8-0b44590bb226 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.795429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50d782-2837-48a5-b4e8-0b44590bb226 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.795845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50d782-2837-48a5-b4e8-0b44590bb226 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.797344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 263/539] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:04.806227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.806533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.806802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.843314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:04.845002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.846899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:04.855150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ae914-8a23-460a-a663-4539f6502376 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:04.916559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:04.917318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:04.917600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:04.917876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:04.928829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:04.933178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:04.934705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:04.954426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:04.955351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:04.956659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 277/540] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:04.962290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 264/541] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:04.963162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.040373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.139908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91678973-03e1-4c77-af7b-aba4228cc1ed None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.206194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.206808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.207090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.207366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.208166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:05.208502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:05.210089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:05.226048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a31e6-f5ce-419e-97a1-84c2952e339b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.238953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 278/542] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:05.244779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.277693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:05.286847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.287705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.287986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.288257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.310765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:05.324076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:05.324999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:05.325783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:05.327545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 265/543] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:05.338568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.401294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:05.462769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe04d-6728-4b78-8328-b6dcf4387b82 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.472888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3fef8-54e6-4956-944a-0e78d25141ac None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.510070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98952787-2559-4f24-898f-69d83a203167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.510805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98952787-2559-4f24-898f-69d83a203167 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.511088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98952787-2559-4f24-898f-69d83a203167 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.511510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98952787-2559-4f24-898f-69d83a203167 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.512275 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98952787-2559-4f24-898f-69d83a203167 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:05.512615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98952787-2559-4f24-898f-69d83a203167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:05.514015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98952787-2559-4f24-898f-69d83a203167 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:05.523702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 266/544] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:05.529391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98952787-2559-4f24-898f-69d83a203167 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.538358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.539031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.539313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.539655 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.540503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=22dd3a6e312242f5a0bfbcaa90359732) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:05.540853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:05.542299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9185b5-c399-45ca-ac25-0530f46ea32c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:05.548057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 279/545] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/role_assignments?user.id=22dd3a6e312242f5a0bfbcaa90359732&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:05.549390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783037-3291-42cb-ad62-8d20bae28944 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.549678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783037-3291-42cb-ad62-8d20bae28944 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.549950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783037-3291-42cb-ad62-8d20bae28944 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.551465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 280/546] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:05.562163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.562485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.562792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.593688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:05.595291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:05.639889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:05.644274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98952787-2559-4f24-898f-69d83a203167 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.686325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.687254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.687543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.687814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.700834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:05.702395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:05.722026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:05.722928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:05.723776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:05.723776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:05.723776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:05.723776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:05.723776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 267/547] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:05.732501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.766269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 281/548] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:05.801319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.831953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:05.842135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640d3a-4c8b-458e-b9e6-58437b4162a1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.878707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.879429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.879713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.880040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:05.880804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:05.881336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:05.882508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:05.895441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 268/549] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:05.901076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:05.914461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:05.937999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a651d-8cfb-4619-95b4-d5095fe0f73d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:05.983824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:05.985108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:05.985615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:05.986086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.004905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:06.006203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1b01-227e-4cef-9481-70d26b489241 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:06.021616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:06.023119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:06.024188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:06.027047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 282/550] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:06.033114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:06.048143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.049044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.049355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.049638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.060221 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.061736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:06.096991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:06.097993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:06.098916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 269/551] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:06.103836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:06.114287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:06.147732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54e932-bd1b-451a-80d8-454deac8aab3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.187117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.190041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.190531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.191027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.192172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:06.193497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.195477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.213649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 283/552] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:06.220799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:06.268919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:06.342668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3f6f1-73e3-4086-b8db-6eb4c2e977bb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.378453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42af671-0081-42d7-9644-14ee480cb0a9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.383138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.384093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.384598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.385064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.386086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:06.386574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.388725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.412038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 270/553] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:06.418542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:06.477405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.478243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.478495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.478769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.482408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:06.502271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.503763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:06.542745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:06.543759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:06.544668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:06.544668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:06.544668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:06.544668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:06.547031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 284/554] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:06.550043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:06.585507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e0b2-4e3c-4bc7-84b4-5a2780db98d0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.625801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:06.642335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc41c11-264b-4625-bcb9-0496f77644b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.642994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41c11-264b-4625-bcb9-0496f77644b3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.643278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41c11-264b-4625-bcb9-0496f77644b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.643551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41c11-264b-4625-bcb9-0496f77644b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.746910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ec5e4-19a7-4b12-bde5-fc9e289e6113 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.752197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc41c11-264b-4625-bcb9-0496f77644b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.753902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc41c11-264b-4625-bcb9-0496f77644b3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.787351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.788025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.788306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.788866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.790492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:06.790806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.792205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878a8f7-4eb8-491f-a0e2-a5ca7e7f3f8b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.808119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 285/555] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:06.810028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f821f-c0b3-499f-9143-c69c4386db8f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.810318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f821f-c0b3-499f-9143-c69c4386db8f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.810597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f821f-c0b3-499f-9143-c69c4386db8f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.812622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 286/556] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:06.813391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f821f-c0b3-499f-9143-c69c4386db8f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:06.865479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:06.877635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 271/557] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:06.879649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.879942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.880220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.906133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:06.908553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:06.928944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f821f-c0b3-499f-9143-c69c4386db8f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:06.942562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:06.966177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:06.966982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:06.967259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:06.967528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:06.975026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:06.976496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:06.991287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:06.992826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:06.993755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:06.997470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 287/558] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:06.998301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.003471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 272/559] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:07.004684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.101705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd1f8-65d6-452c-b559-aca750e347aa None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.109098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.119308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27963bc0-4941-4fdc-a3f2-0c9d00532413 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.138321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.139151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.139430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.139702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.149474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.150924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.157021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.157990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.158445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.159107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.160022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:07.160403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.161899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-93173ee9-0e04-4414-82e3-b73e12781fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:07.169417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:07.170342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:07.171233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:07.171233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:07.171233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:07.171233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:07.171233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 288/560] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:07.172109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77dea0-70bf-4524-bf2a-dca0a5d2a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.172400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77dea0-70bf-4524-bf2a-dca0a5d2a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.172677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77dea0-70bf-4524-bf2a-dca0a5d2a8f0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.174044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 289/561] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:07.177399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77dea0-70bf-4524-bf2a-dca0a5d2a8f0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.186145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 273/562] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:07.187019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.211252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.289496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77dea0-70bf-4524-bf2a-dca0a5d2a8f0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.295952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759feb23-1b7b-4f0b-b686-ffb1e66e604b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.325285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab271-744d-421e-9537-778923253549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.326086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab271-744d-421e-9537-778923253549 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.326366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab271-744d-421e-9537-778923253549 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.326641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab271-744d-421e-9537-778923253549 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.331031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.331752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.331984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.332577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.333294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:07.333606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.334995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b584af-071f-4a0b-bdb3-9d725f3cbae3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.338003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ab271-744d-421e-9537-778923253549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:07.350566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 274/563] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-198ab271-744d-421e-9537-778923253549 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:07.350740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:07.351590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:07.352545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:07.353189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.353189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.353311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 290/564] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:07.353386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.353453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab271-744d-421e-9537-778923253549 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.369061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:07.370639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:07.375353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.447148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 275/565] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:07.448712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.462929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.478928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab271-744d-421e-9537-778923253549 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.514401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.515211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.515494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.515767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.526241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.527702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:07.545287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:07.546354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:07.547384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:07.547384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:07.547384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:07.547384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:07.547384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 291/566] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:07.547745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.565712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592817a-5881-49ad-b669-32d697fb47c3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.601909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.602805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.603023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.603296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.610058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.611521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:07.625351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:07.626454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:07.627651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:07.628192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.631197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 276/567] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:07.632045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.663108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1a308-cc2f-456a-8986-54e3b4e8b70a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.703686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.714075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.715079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.715500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.715912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.717115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:07.717592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.719651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.729781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 292/568] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:07.730769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.750957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f9d0-830b-4835-9e26-7de059826aba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.786201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.787029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.787293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.787568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.798127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:07.805719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:07.806636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:07.807482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 277/569] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:07.808177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.843681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef8a5-de30-4c57-acc5-9d33dcd13d5b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.875058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.880464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.881167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.881453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.881733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.882450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:07.882758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.884194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.900214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 293/570] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:07.900214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.916933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040a98-324f-404f-af98-c34e4638e61a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:07.941871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:07.951426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:07.952093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:07.952376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:07.952688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:07.953486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:07.953800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:07.955242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:07.967359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 278/571] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:07.968143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:07.993495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6faad6-8f5d-41f4-8511-e473c828b64a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.025913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.026718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.027002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.027278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.037514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.039070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d6c6cc31-56bb-49b7-9bf2-4d9921a2022d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:08.058106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:08.059227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:08.060114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:08.060114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:08.060114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:08.060114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:08.060114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 294/572] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:08.060693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507828ba-6291-4e22-a47e-eec6ba76b490 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.060979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507828ba-6291-4e22-a47e-eec6ba76b490 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.061249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507828ba-6291-4e22-a47e-eec6ba76b490 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.062899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 295/573] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:08.063196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507828ba-6291-4e22-a47e-eec6ba76b490 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.083069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad3d4-acfb-47b5-bc82-e91e7c20ff64 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.110114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.118963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.119795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.120080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.120349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.121129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:08.121444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.122819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.131273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 279/574] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:08.131996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.168742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507828ba-6291-4e22-a47e-eec6ba76b490 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.180713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.204222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.205060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.205343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.205614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.212376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.213876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:08.227258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:08.228274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 296/575] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:08.229584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.235463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177cbc6-d908-45f6-a750-4101ee50cf46 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.268299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.268980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.269261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.269537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.270370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c18feb5be4814673933b8e140a91b2a8) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:08.270684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.272120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6cbae-ede3-4aa4-a93b-c8909a07f9eb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.277623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 280/576] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/role_assignments?user.id=c18feb5be4814673933b8e140a91b2a8&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:08.278809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.279124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.279428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.297356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:08.298598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:08.336110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f91304-64f7-42c4-9a84-07807b179415 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.340390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.373850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 281/577] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:08.374500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.388182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.389488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.389979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.390704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.392258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:08.392842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.394961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.409026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 297/578] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:08.410378 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.434773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.494284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70f898-0b53-4fd2-bca5-03d8bdeaf381 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.522067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eaafd-fd47-4df5-9930-eb1dd254d9c0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.529763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.530627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.530909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.531175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.541460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.542932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.559973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:08.560157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:08.560996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:08.566752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:08.566752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:08.566752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:08.566752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:08.566974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.566974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.566974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.567178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 282/579] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:08.567247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:08.567316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.567391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.567391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.584551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 298/580] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:08.584551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.613134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.666501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.674352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16131f1-e5eb-4260-a2ce-ab3fb6fd2447 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.692307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7faa9-61ed-4437-b3c7-588a0abd1e88 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.710735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.711577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.711860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.712162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.724083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:08.730566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.731379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.731665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.731940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:08.732099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:08.733015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:08.733918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 283/581] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:08.735229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.746897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.748370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:08.763197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:08.764162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 299/582] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:08.765158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.847457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e7bb8-2081-47fe-a943-117e4936938a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.860185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.878768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012294e-cb1a-4c72-9745-ef932af5b7e5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:08.880996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.881934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.881934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.882212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.882940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:08.883283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.884709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.897945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 284/583] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:08.898510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:08.915596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:08.921184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:08.922034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:08.922318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:08.922578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/89e2cefbcf0449ff8fb8b695bba26dd3/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:08.937691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=89e2cefbcf0449ff8fb8b695bba26dd3, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:08.939200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:08.964580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 300/584] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:08 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/89e2cefbcf0449ff8fb8b695bba26dd3/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:08.964580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.032831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8bcd7-61b7-4fb5-82ce-52d869e53ddb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.080047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.080940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.081322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.081708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.082631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:09.083014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.084742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.094238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a9fd4-bab6-40db-842b-1da117f43701 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.100531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 285/585] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:09.101605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.136706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.137405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.137690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.137972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.138825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:09.139148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.140640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.142550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:09.168081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 301/586] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jul 21 05:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:09.168081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.203355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:09.235205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc0be7-9ac1-40f5-9386-12c204b66871 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.275717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1b784-45aa-4f58-b207-5b016b796047 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.279859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.280884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.281329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.281742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.293298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.295643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:09.313986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:09.314998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 286/587] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:09.317105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.325377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.326203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.326489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.326768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.338063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.339534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:09.357746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:09.358898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:09.359984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:09.359984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:09.359984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:09.359984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:09.364024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 302/588] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:09.365014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.434393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:09.443497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f19bf-67bf-4a24-8e8f-69342daf04aa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.483396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.484119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.484402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.484727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.487923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:09.497489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.499661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.506463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e45fe-44e8-4aa3-9a0c-e83d424c484e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:09.518693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:09.519591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:09.520618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:09.520618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:09.520618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:09.520618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:09.520618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 287/589] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:09.521394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.548133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.549542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.550143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.550619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.551878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:09.552391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.554425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.574329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 303/590] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:09.575441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.634988 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda4f27-8e03-44e3-964c-298689fd207d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.671496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.672465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.672597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.672836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.673565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:09.673872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.675259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.682413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a5447-b7e9-41d1-a6e2-1a882b26c249 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.684361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:09.693043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 288/591] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:09.693914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.721734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.722912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.723399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.723881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.725047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:09.725650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.727344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.740800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 304/592] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:09.742114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.749460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:09.806918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a44c9-a62e-429a-a95d-61c92d3ac698 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.845604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.847571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.848677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.849052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.856658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad9ce-528d-4dbe-b15c-72d72d571dc4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:09.862032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.863599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:09.881710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:09.882780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:09.883730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:09.883730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:09.883730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:09.883730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:09.888505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 289/593] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:09.889424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.899598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:09.901077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:09.901544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:09.902301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:09.912503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:09.914510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:09.931683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:09.932669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 05:27:09.933632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:09.938281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 305/594] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:09.939219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:09.965403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.019192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.024951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffcb2e-e887-418d-8a01-d30848f4e887 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.047120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5512b53-28af-45d7-809c-fb096f3c98bb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.071010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.072777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.073510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.073983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.083316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.083505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.084370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.084751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.085091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.085817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.085923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:10.086275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.087788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:10.103323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:10.104269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:10.105208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:10.105640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 306/595] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:10.106929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.108045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 290/596] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:10.109149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.218998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.239852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189c33-7fcd-449a-9bab-c64e989a607e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.245395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b6e4e-fbb4-457f-b62c-9b2923a6ac9a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.275005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.275882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.276273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.276648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.284494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.286191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.290846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.291753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.292238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.292717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.293965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:10.294424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.296016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:10.301708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:10.302794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:10.304017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:10.310257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 291/597] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:10.311325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.319027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 307/598] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:10.320439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.339141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.429542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d434b-8146-4ff3-b0ea-98f854196f92 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.435322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096813b9-dabc-4065-a934-c5b8d664f694 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.465020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.465710 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.465971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.466247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.467032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:10.467345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.468839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb53cd-e8fb-4cca-a7f0-446997fdf7fa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.474611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.475613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.476072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.476545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.477257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.478371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:10.478920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.480551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.480665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 308/599] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:10.481903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04513e-e578-4203-b14b-59c865442d68 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.482188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04513e-e578-4203-b14b-59c865442d68 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.482462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04513e-e578-4203-b14b-59c865442d68 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.487838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 309/600] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:10.488633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04513e-e578-4203-b14b-59c865442d68 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.503591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 292/601] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:10.504506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.591409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.591647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04513e-e578-4203-b14b-59c865442d68 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.615175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2725-ff93-4ce6-b86b-5ecc0eccd361 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.626115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.626922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.627199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.627466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.637708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.639188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.651770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.652984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.653467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.653941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/535729140fea45e99aa556d85913ae08/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-983a4b9b-b236-45ed-9280-8d35b54025bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:10.656773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:10.657652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:10.658551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:10.658551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:10.658551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:10.658551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:10.658551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 310/602] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:10.659240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.659420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.659694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.676018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:10.676995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=535729140fea45e99aa556d85913ae08, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.677246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:10.678873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.692464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 293/603] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:10 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/535729140fea45e99aa556d85913ae08/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:10.693585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.748677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.780943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 311/604] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:10.782117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.840139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317ce8-50fc-40a0-b9a8-51fe03a0bd7e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.884534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:10.895841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.897162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.897651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.898140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/876f25e90653467bb67a7f406cc9a8b8/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.904058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee91847-90cd-425a-92c2-f38e117b703c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:10.914314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=876f25e90653467bb67a7f406cc9a8b8, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.915713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:10.933733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 294/605] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:10 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/876f25e90653467bb67a7f406cc9a8b8/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:10.935036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:10.963248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:10.966192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:10.966554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:10.966838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:10.970277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:10.970708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:10.974599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.006076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 312/606] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:11.008841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.085981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.146144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30568d2b-599e-4c19-b217-5c302e688fd7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.158620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1b278-9669-4ae2-a12b-36d166fddbbc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.190724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06f67-b10c-4eb8-8ae4-d689855e713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.191729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06f67-b10c-4eb8-8ae4-d689855e713f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.192078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06f67-b10c-4eb8-8ae4-d689855e713f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.192417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06f67-b10c-4eb8-8ae4-d689855e713f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.196638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.197644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.198154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.198635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.204118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06f67-b10c-4eb8-8ae4-d689855e713f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:11.206568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.208234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6ec06f67-b10c-4eb8-8ae4-d689855e713f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:11.212243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:11.213230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:11.214073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 295/607] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:11.215426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651fbd-38fd-45a3-ad95-c81f72d61b08 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.215711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651fbd-38fd-45a3-ad95-c81f72d61b08 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.215985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d651fbd-38fd-45a3-ad95-c81f72d61b08 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.221403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 296/608] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:11.222193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651fbd-38fd-45a3-ad95-c81f72d61b08 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1a810a52-8c1f-451e-8b70-cd6307bdd067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:11.227613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:11.228563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:11.229549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:11.230397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 313/609] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:11.231446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.231734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.232047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.255928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:11.257134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:11.268166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.325159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 314/610] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:11.326014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.340378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d651fbd-38fd-45a3-ad95-c81f72d61b08 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.355863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.389858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.390638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.390930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.391206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.392064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:11.392381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.393825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.403049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 297/611] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:11.404026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.433851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a32641-7b67-4555-a444-2f008271f9b7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.476504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.477690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.478109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.478522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.479766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:11.480241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.482584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.499631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 315/612] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:11.500913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.511758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939672-d523-49c3-ab06-e11432b4a094 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.513573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.549609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.550478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.550758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.551083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.562571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:11.571354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:11.572280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:11.573149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:11.576844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 298/613] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:11.577832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.599857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.608648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91eae4-5fe3-41d5-a497-bc095b2d7d09 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.644378 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.645247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.645528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.645790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.656939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.658339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:11.676075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:11.677230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:11.678309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:11.678309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:11.678309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:11.678309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:11.678309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 316/614] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:11.678791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.689575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8534-3e89-4e0f-b3b9-f157ac93d2da None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.725424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.727293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.728022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.728522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/22dd3a6e312242f5a0bfbcaa90359732/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.747882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=22dd3a6e312242f5a0bfbcaa90359732, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.750698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.768216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 299/615] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:11 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/22dd3a6e312242f5a0bfbcaa90359732/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:11.769790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.791315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.794748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad5a78-5039-428c-a575-921341c80673 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.848010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.848921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.849482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.849783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.851244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:11.851923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.854326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.871962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 317/616] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:11.876055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.889391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:11.904246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518297-8f1a-4fcd-9ec3-0968f162243b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:11.941724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:11.942659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:11.943166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:11.943669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:11.944987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:11.945490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:11.947135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:11.960028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 300/617] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:11.967194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:11.996505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ad84e-4254-4b50-b827-9f52a85dac04 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.032986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.033886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.034174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.034445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.047389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:12.048959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:12.067565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:12.068579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:12.070097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:12.070097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:12.070097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:12.070097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:12.070097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 318/618] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:12.077366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:12.106079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:12.146829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14912a35-04d6-4f6b-9d35-ca026a41e1ee None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.152626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:12.198608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.200662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.201182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.201886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.208042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03b1b3-583f-4275-a90f-e6982413679e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.213475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:12.215172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:12.234441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:12.235534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:12.236694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:12.238961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 301/619] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:12.246471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:12.263475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.264158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.264435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.264725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.265448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:12.265748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:12.267212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:12.280553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 319/620] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:12.286368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:12.390654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf361-02bf-4f73-9fb3-dbf3ffcd7558 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.424871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:12.437155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.438112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.438488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.438974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.448257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:12.450117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:12.467210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:12.468389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:12.469374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:12.469905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 320/621] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:12.475545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:12.530695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80795ee0-7fdd-4da3-aa3c-3587b67223e4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.586208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:12.594778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.595792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.596070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.596342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.601318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:12.602071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:12.606040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:12.641670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 302/622] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jul 21 05:27:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:12.647889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:12.672654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc96229-104d-45bd-935d-dce3b55142db None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.742414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.743639 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.744933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.745570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.747706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:12.748414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:12.750939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:12.786959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 321/623] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:12.792904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:12.845885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e01038-c724-4203-a5a1-005cb5b6513f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.858754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:12.921606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6787bb-a5d6-4b03-b67a-8bc944e3210f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:12.957578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3005c97-14aa-440e-89fd-d09a4c39d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.958250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3005c97-14aa-440e-89fd-d09a4c39d31e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.958539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3005c97-14aa-440e-89fd-d09a4c39d31e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.958826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3005c97-14aa-440e-89fd-d09a4c39d31e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:12.969186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:12.970012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:12.970293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:12.970573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.005491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.006904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.028644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3005c97-14aa-440e-89fd-d09a4c39d31e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.030566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3005c97-14aa-440e-89fd-d09a4c39d31e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b3e384bb-daba-4a49-806c-2788b6013a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:13.050029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:13.050975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:13.051874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:13.051874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:13.051874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:13.051874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:13.054204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 303/624] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:13.055794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c92d9-23b1-414f-b997-3c3b3697bcba None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.056382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c92d9-23b1-414f-b997-3c3b3697bcba None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.056888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c92d9-23b1-414f-b997-3c3b3697bcba None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.058339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 304/625] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:13.064685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c92d9-23b1-414f-b997-3c3b3697bcba None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.067008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.130091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.142579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 322/626] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:13.143967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.144261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.144600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.161109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:13.162840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:13.200379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c92d9-23b1-414f-b997-3c3b3697bcba None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.240554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 323/627] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:13.240752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.240858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.240975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.240975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.240975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.240975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:13.240975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.240975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84e346-7413-4146-8f7e-d9279f4fd2f0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.264584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 305/628] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:13.264584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee966a29-4194-451f-8d40-cd0705df226f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.264584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee966a29-4194-451f-8d40-cd0705df226f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.264584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee966a29-4194-451f-8d40-cd0705df226f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.264584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 306/629] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:13.264584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee966a29-4194-451f-8d40-cd0705df226f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.321614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.367534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043fe7d-f85e-405a-901f-7f8e45d0305e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.374523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee966a29-4194-451f-8d40-cd0705df226f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.376058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.403531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.404343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.404651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.404922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.415196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.416295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635d2db-6e5c-4208-948b-d521326efe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.416694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.417133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d2db-6e5c-4208-948b-d521326efe2c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.417414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d2db-6e5c-4208-948b-d521326efe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.417714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d2db-6e5c-4208-948b-d521326efe2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.433183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635d2db-6e5c-4208-948b-d521326efe2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:13.434650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:13.435579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:13.436574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:13.436574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:13.436574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:13.436574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:13.440508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 324/630] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2635d2db-6e5c-4208-948b-d521326efe2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:13.440786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:13.441971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:13.449404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:13.451470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.451608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 307/631] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:13.451608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.451608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.451608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.461687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:13.462971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:13.529179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 308/632] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:13.530281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.561659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2165f29-581f-4e46-93b2-64f694e188c6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.581469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.601467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.602566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.603046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.603506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.610617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.612281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.621728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:13.627623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:13.628744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:13.629817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:13.631885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 325/633] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:13.632160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4ac20-0260-4471-a36a-a4d36730e76c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.632999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.666813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.667495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.667792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.668066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.668829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:13.669135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.670565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.682007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 309/634] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:13.684910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.746310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3d4a0-95fd-409b-8048-e0a356090fd1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.782443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.783044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.783327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.783607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.784361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:13.784710 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.786116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.794401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 326/635] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:13.795198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.813550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c184b-c4db-4b64-8bfe-4cf5d9a6eecb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.844199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.852671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.853488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.853773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.854048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.866752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:13.874609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:13.875605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:13.876446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 310/636] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:13.877617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.893681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:13.909594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec89f1-5935-4f2b-89d8-29fecb8c7b49 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:13.946464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:13.947168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:13.947571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:13.947850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:13.948659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:13.948970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:13.950519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:13.968062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 327/637] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:13.968062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:13.989411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d9372-49de-4499-8a43-f977540137c5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.024628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.025614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.026017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.026387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.033298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.034775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:14.049390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:14.050571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:14.051620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 311/638] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:14.053306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.068716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.072814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0767-90b4-4471-840d-42758ae943cc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.107724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.108642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.108989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.109358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.119787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.121356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.132603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:14.139217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:14.140152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:14.141586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:14.141586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:14.141586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:14.141586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:14.141586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 328/639] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:14.141586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.169649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98425ee-ab0d-40f3-a27b-336aedf4bd3e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.206471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.207147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.207431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.207705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.208458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:14.208802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.210175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.218363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 312/640] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:14.219191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.247504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3967c-c81a-4c3d-98d7-a4efc34d0aa3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.279990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.281129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.281408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.281683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c18feb5be4814673933b8e140a91b2a8/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.295455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=c18feb5be4814673933b8e140a91b2a8, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.296943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.309485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 329/641] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:14 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c18feb5be4814673933b8e140a91b2a8/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:14.310271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.313058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.321682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd13155-a24f-43c5-adf0-52d1213f8e74 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.359314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.360004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.360280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.360580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.361375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:14.361687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.363159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2da6f-016b-4324-8087-be3f2d12fc4e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.365111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.377397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 313/642] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:14.378756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db4e1-9888-4379-98da-9a7cadb8813d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.379040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db4e1-9888-4379-98da-9a7cadb8813d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.379312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db4e1-9888-4379-98da-9a7cadb8813d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.384543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 314/643] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:14.384543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db4e1-9888-4379-98da-9a7cadb8813d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.444011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee43b-caa3-4b39-9dd1-40697025d52c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.482846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.483529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.483818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.484091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.484873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:14.485185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.486603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.499766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 330/644] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:14.501160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.513480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db4e1-9888-4379-98da-9a7cadb8813d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.550978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.551724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.552003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.552273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.562530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.563986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.571494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6aa9152d-13a1-4fcf-8161-f2dbe01f500b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:14.583105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:14.584032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 315/645] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.589877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.603261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:14.604443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:14.615718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25db8-6d75-49c1-9165-0cd8855f6531 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.649994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.651490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.652168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.652502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.653011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.653894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=89e2cefbcf0449ff8fb8b695bba26dd3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:14.654177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.656239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.668503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 331/646] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/role_assignments?user.id=89e2cefbcf0449ff8fb8b695bba26dd3&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:14.668503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.675837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 316/647] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:14.676752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.829870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec188bb2-ac8b-4ad8-a789-3d0c357e17ef None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.831102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9f30a-646e-459a-b0e3-518318bfc57c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:14.865023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:14.876550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.877243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.877527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.877805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.878070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:14.878541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:14.878850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.879529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:14.880007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:14.880242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.880723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:14.890438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:14.892735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:14.896587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 317/648] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:14.896587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:14.911149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:14.912151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:14.913143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:14.914280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 332/649] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:14.914761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:14.947866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.021906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e462-457e-414d-b9a7-1a8b553c98f0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.055343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4175-7202-4c66-86a0-d92698a8cd7c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.057211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.057974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.058263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.058536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.069776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:15.077474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:15.078419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:15.079257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 318/650] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:15.079997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.101205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.102414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.102912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.103384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.115573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.117089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:15.131971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:15.133012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 05:27:15.134009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:15.138216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 333/651] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:15.139108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.188959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.200688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.208083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e0ed5-89d1-4699-8610-8a81d01b6546 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.243207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.243883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.244171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.244442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.245331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:15.245641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.247089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.264941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932105-6c4c-4956-a2ac-815e8592137c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.269924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 319/652] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:15.269924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.316114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.317372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.318262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.318829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.320212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:15.321014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.322950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.332905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 334/653] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:15.333784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.385141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d01bf-9858-4b5b-9944-c557c0f9dbd4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.430564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.431751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.432238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.432734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.433930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:15.434447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.436287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.456305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 320/654] 10.222.0.18 () {56 vars in 1137 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:15.457746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.464258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f1540-a41d-429d-b06c-1af93b68fbc6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.473938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.476612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.509813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.510724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.511010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.511285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.578807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ca39-f967-4bd3-a045-fc09de0ca010 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.601245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.603903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.621053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.622116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.622397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.622670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.635844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.637824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:15.661258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:15.662562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:15.663465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:15.663465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:15.663465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:15.663465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:15.667594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 321/655] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:15.668595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.730472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 335/656] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:15.730472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.738730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.745353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.787805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65505bd3-4f66-45e6-a4c0-4499c9982686 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.829295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.829962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.830251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.830960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.849305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a526bc-a736-4ee5-8ee0-98cef23c22ef None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:15.890900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:15.891480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:15.891762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:15.892037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:15.892802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:15.893109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.895115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.916091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 336/657] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:15.917247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:15.930694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:15.932683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:15.989248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:15.997836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.027503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb536665-68e1-45cc-baca-caf63215f606 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.039584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 322/658] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:16.040691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.064592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.065916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.066738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.067158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.081873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.084387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:16.107365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:16.108447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:16.109590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:16.109590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:16.109590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:16.109590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:16.112226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 337/659] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:16.113251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.151360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485651b5-d0f8-4454-85a8-b532f81f94e6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.190539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.191845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.192658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.193331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.203504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.205175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:16.225392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:16.226593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 05:27:16.227895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:16.231030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 323/660] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:16.232000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.243207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705880ea-e1d8-454c-ba3f-1d2a753e1286 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.259421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.274594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.293698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.294862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.295526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.296356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.309913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.311575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:16.329853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:16.330991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:16.332081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:16.332081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:16.332081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:16.332081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:16.332430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 338/661] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:16.333028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.355560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd4738-0741-4a75-b331-3f9b4490abf6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.394766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.395433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.395712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.395987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.396749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:16.397052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.398433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.410390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 324/662] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:16.411164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.448171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da6f81-308a-4170-999c-e9f49e71aa7b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.484374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.485243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.485519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.486542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.487389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:16.487702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.489184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a61b67-1b06-4856-a058-783a0ae4a227 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.501095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.512148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 339/663] 10.222.0.18 () {56 vars in 1139 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:16.512148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea5f5a-48aa-449b-88c9-14a20e846537 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.512148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea5f5a-48aa-449b-88c9-14a20e846537 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.512148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea5f5a-48aa-449b-88c9-14a20e846537 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.512148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 340/664] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:16.512148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea5f5a-48aa-449b-88c9-14a20e846537 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.521498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97450b3-efd9-46b7-80f8-7cd7e4064b92 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.544396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.560024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.560728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.561007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.561281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.562004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:16.562310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.563676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.575958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 325/665] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:16.577712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.622415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea5f5a-48aa-449b-88c9-14a20e846537 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.658675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.659887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.660199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.660538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.667379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.668846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a87d4e8a-db83-4577-8648-65cc656a19bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:16.682338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:16.683286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:16.689224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:16.689669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a7104-f1d6-48a4-bc17-89b807f897f8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.690074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 341/666] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:16.690074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.690074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.690074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.702268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:16.703465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:16.727362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.727970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.728250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.728548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.746055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.769826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 342/667] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:16.770705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.799932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:16.808513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.809980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.879103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0268d58-7df1-4dba-98ca-9673cf10de72 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:16.905983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 326/668] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 05:27:16.906820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.912262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:16.913021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:16.913306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:16.913582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:16.920564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:16.922022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:16.935989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:16.936918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:16.937801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 343/669] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:16.938306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:16.956219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.009597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9b423-2c57-4e39-b841-3f033403fa76 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.018569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.037824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff4ff-1c92-474d-8165-5ef856f3600b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.044257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.044946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.045229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.045505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.046291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:17.046592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.048025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf7f42-bf3a-4ca4-80fc-8ebfdc57705c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.059463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 327/670] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:17.060684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b9f7-c7a7-426c-af49-82d78f2a05f5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.060973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b9f7-c7a7-426c-af49-82d78f2a05f5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.061251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185b9f7-c7a7-426c-af49-82d78f2a05f5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.062634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 328/671] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:17.063150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b9f7-c7a7-426c-af49-82d78f2a05f5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.075303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.076107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.076391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.076702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.087408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:17.095031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:17.096000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:17.096884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 344/672] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:17.097604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.169188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185b9f7-c7a7-426c-af49-82d78f2a05f5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.171805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.197652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734118-3fa6-4370-8e1e-07bd1c869091 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.205081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.205892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.206179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.206458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.216613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.218068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.230309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.230966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.231252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.231526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.232319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:17.232662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.234098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fdd84-2ec3-4713-9d84-ec3130fb6964 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:17.235088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:17.235993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:17.242222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:17.242222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:17.242222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:17.242222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:17.242222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 329/673] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:17.242222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.244730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.253088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 345/674] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:17.253088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.253088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.253088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.267109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:17.268273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:17.333538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 346/675] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:17.334338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.334974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ba11d-7ae7-4e5e-a366-f34f91555a1a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.371796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.372460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.372777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.373052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.373879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=535729140fea45e99aa556d85913ae08) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:17.374191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.375646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.381535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 330/676] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/role_assignments?user.id=535729140fea45e99aa556d85913ae08&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:17.382287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.405533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.441412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783fffc-3d19-4a46-b96f-0e7a6ca7269a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.474816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.482128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.482828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.483110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.483382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.484145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:17.484454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.485893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.499731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 347/677] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:17.499731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.505974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cdfc-a844-4b31-a7d5-a221ec898061 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.545679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.546071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.546358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.546635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.547369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:17.547677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.549092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.562382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 331/678] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:17.563315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.608302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f42c4-617f-437a-b9aa-9e094b9ca029 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.641582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.642242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.642523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.642796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.643625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=876f25e90653467bb67a7f406cc9a8b8) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:17.643930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.645411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.651672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 348/679] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/role_assignments?user.id=876f25e90653467bb67a7f406cc9a8b8&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:17.652340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.662458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.693693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3f9ca-eb27-456b-8fc5-b93d85e4edd5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.721736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.754288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.755112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.755389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.756616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.776165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:17.782322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509f73a-977f-4094-944d-0e7a6e93e2cc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:17.784056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:17.785163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:17.785982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:17.790496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 332/680] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:17.791478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.829947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.830886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.831175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.831447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.844366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.845970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:17.865198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:17.866165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:17.867244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:17.867244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:17.867244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:17.867244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:17.867244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 349/681] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:17.868867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:17.924940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda92428-102c-4c3e-9e11-0668893068a9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.962818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:17.964054 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:17.964552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:17.964992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:17.973126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:17.975598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:17.982158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbbe3b-0113-4368-ac75-b8fa5abbddc3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:17.991429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:17.994111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:17.994976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:17.995934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:17.998527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 333/682] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:17.999624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.004773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.018152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.018839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.019124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.019401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.020561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.020880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.022578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.033448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 350/683] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:18.034590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.113959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37fbcd-dbd3-411f-b64b-fe8b2757a486 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.151449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.152536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.153138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.153728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.154695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.155190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.156511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367be1c-bcb1-4708-90bc-7bb56676421f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.156987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.177747 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 334/684] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:18.178978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.197376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.198059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.198469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.198758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.200054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.200389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.202315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.217812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 351/685] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:18.218747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.246240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.260844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.295655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170eb9c-08a9-49c1-857e-7fe5fae23313 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.326984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628714d-a2c1-46a6-a84f-06681e7c71d7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.330691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.331582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.331928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.332266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.343468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.345068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.361223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.362035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.362318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.362592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:18.362976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:18.363827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:18.364756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:18.364756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:18.364756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:18.364756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:18.364756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 335/686] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:18.366001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.370811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.372406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:18.387743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:18.388964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:18.390187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:18.394118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 352/687] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:18.394996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.488629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec82ea-e0b7-40ad-ab48-53286bec6421 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.500788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af756-e359-49d6-9080-fa56182a648e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.502085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.524947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.525379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.526173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.526531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.527060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.528063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=22dd3a6e312242f5a0bfbcaa90359732) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.528356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.530576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.536270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.536974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.537258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.537533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.538257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.538563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.539982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.545073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 336/688] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/role_assignments?user.id=22dd3a6e312242f5a0bfbcaa90359732&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:18.546098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.553752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 353/689] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:18.559160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.669449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be564044-6685-418b-bd60-af8042c1f00e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.707758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.709012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.709505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.709953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.718712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.720764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:18.737253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:18.738282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:18.739272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:18.742029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 354/690] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:18.748129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.764908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.778696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a653a5-daaf-4825-b4bc-1abb8642f571 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.845659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.846364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.846644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.847260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.847843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.848151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.849627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.860194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d54d2-d4b3-4456-81f6-7a639977efa7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:18.868575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 337/691] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:18.873720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:18.896544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:18.897660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:18.898116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:18.898568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:18.899653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:18.900251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:18.902017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:18.910793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:18.923091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 355/692] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:18.928940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.002191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.013067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0d5db-6fae-4249-8ce9-62eb712b4a66 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.037032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479298fc-dfbb-4da0-9814-9545dd59ba9c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.073466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.074529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.075011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.075498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.084798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.085466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.085749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.086024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.146162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.148115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.210870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.212379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.220881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.252331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 356/693] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:27:19.258222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.274526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.358243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3a29b-d387-45f8-a4fa-4c5a79a59ca0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.392312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.393398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.393855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.394279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.405031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.406720 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.410360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 338/694] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 05:27:19.417220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:19.426521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:19.427591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:19.428687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:19.428687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:19.428687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:19.428687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:19.430574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 357/695] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:19.436146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.458917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.537873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a91162-c97e-4034-948b-24a65ad23dec None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.572796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.573750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.574033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.574309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.575033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:19.575336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.576749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b6d62-0686-4200-9554-8bc860f47679 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.591413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 358/696] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:19.593687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57f2d-9b7b-4209-aa1a-2fb0022fff15 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.594180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57f2d-9b7b-4209-aa1a-2fb0022fff15 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.594654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57f2d-9b7b-4209-aa1a-2fb0022fff15 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.600412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 359/697] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:19.601499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57f2d-9b7b-4209-aa1a-2fb0022fff15 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.608984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89bde7-befe-48dd-b744-fe61c70be4dd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.647552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.648949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.649253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.649522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.651920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.666922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.668668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5cc1acda-1a16-4ad0-a34c-c30acb1d66e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:19.687076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:19.688010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:19.688920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:19.688920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:19.688920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:19.688920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:19.688920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 339/698] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:19.689798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.690080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.690355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.700188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.716255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:19.717490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:19.723341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57f2d-9b7b-4209-aa1a-2fb0022fff15 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.760570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.761929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.762682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.763195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.772819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.774648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.796528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 340/699] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:19.796528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:19.798155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:19.799040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:19.799911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:19.802577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 360/700] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:19.807845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.894223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34200e48-51a1-4fa8-ba24-0d7507b2a021 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.913198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.927186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109db17-08d6-40d3-a518-72add96a915c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:19.932654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.933341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.933623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.933896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.934627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:19.934933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.936640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.949494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 341/701] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:19.954814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:19.965170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:19.966254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:19.966797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:19.967262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:19.968402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:19.968910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:19.970638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:19.980943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:19.985193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 361/702] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:19.986462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.061558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61defc0a-d7e6-462e-a61d-274f645afd23 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.086661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314da0-5174-4ed5-8e49-7575ac352730 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.098390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.099205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.099481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.099749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.100404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.101827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:20.118976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:20.119972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:20.121259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 342/703] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:20.122108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.126303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.127110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.127381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.127646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.135008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.136456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-33bef060-67fc-4035-9597-e572fcc577ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:20.150281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:20.151161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:20.152038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 362/704] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:20.153166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e6aad-b5ea-4bb8-8beb-c86e69fd7921 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.153166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e6aad-b5ea-4bb8-8beb-c86e69fd7921 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.153337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e6aad-b5ea-4bb8-8beb-c86e69fd7921 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.154488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 363/705] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:20.157239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e6aad-b5ea-4bb8-8beb-c86e69fd7921 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.169357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:20.221425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:20.232284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eba223-bf15-47d8-ab6d-1aaa6e736381 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.264694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e6aad-b5ea-4bb8-8beb-c86e69fd7921 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.266453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.267303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.267577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.267847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.268707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=89e2cefbcf0449ff8fb8b695bba26dd3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:20.269019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.270451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.284520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 343/706] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/role_assignments?user.id=89e2cefbcf0449ff8fb8b695bba26dd3&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:20.284520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.321820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.322703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.323142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.324387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.325240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:20.325621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.327137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa53f6-4f6b-47f5-a41a-98f7efcdecf4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.336681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 364/707] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:20.338314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.338909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.339184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.360920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:20.362436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:20.413446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f80cd-e01a-4740-b173-bbd64b405332 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.417294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:20.458117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.458838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.459117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.459386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.460219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:20.460556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.461218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 365/708] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:20.462198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.466078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.479266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 344/709] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:20.484943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.526900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:20.582979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacd78a-35c0-4994-ad44-80da0b870950 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.595039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75aac2-b36b-42d3-be57-b0e898b329d4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.636828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.637676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.638059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.638423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.639358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c18feb5be4814673933b8e140a91b2a8) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:20.639768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.641169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.641427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.642542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.643148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.644041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.645659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:20.646116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.647997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.656907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 345/711] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/role_assignments?user.id=c18feb5be4814673933b8e140a91b2a8&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:20.657249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 366/711] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:20.658135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:20.700967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:20.791022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b35c5-a99c-4b9c-859c-e1911f84036f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:20.842136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:20.843774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:20.844246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:20.844736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:20.862230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:20.864106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:20.888618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:20.889593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:20.890511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:20.890511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:20.890511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:20.890511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:20.892658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 346/712] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:20.898349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:21.018568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c027e5-4bc6-41b1-95dd-c59d6198fa19 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:21.036584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:21.054735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:21.055495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.055773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.056041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.056802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:21.057109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:21.058489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6605f-9472-4947-9310-8186b2cd98f1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:21.075796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 367/713] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:21.077184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:21.163860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:21.184610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc3ac-f1bb-4bfc-8b00-9df04b4fb502 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:21.189222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b89aa-a6b6-4b1f-8e57-c60b8c40910e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.189728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b89aa-a6b6-4b1f-8e57-c60b8c40910e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.189906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b89aa-a6b6-4b1f-8e57-c60b8c40910e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.191238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 368/714] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:21.196992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.197279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.197560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.215851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:21.217174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:21.227367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:21.228423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.228731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.229005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.230054 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:21.231770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:21.260569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 347/715] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:27:21 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:21.300418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 369/716] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:27:21.324121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:21.456190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4e00-0068-4d54-b18c-50f9de3a387f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:21.499069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:21.500059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.500335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.500674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] PATH_INFO: `/v3/services/network` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.501339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:21.502789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:21.505938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:21.516276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:21.517531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:21.518396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 348/717] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:21 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:21.524114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:21.638723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136979c-6cc0-4978-8966-1e05965993d0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:21.654272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:21.675745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:21.676360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.676665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.676985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.677660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] RBAC: Adding query filter params (name=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:21.678185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:21.680004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da7d8d-bc16-44c9-bfec-1163de8f4070 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:21.685228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 370/718] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:21.690972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:21.809975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9613da-6583-420c-8529-b3ae6aecb9bc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:21.855830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:21.856511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:21.856806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:21.857080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:21.857794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] RBAC: Adding query filter params (type=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:21.858100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:21.859493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14743b2-0a1c-490f-979e-d6e9531225db None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:21.870564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 349/719] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:22.798366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132e21-78b6-4ff8-bd78-6a1cc3a8bd37 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:22.798880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132e21-78b6-4ff8-bd78-6a1cc3a8bd37 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:22.798958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132e21-78b6-4ff8-bd78-6a1cc3a8bd37 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:22.800576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 371/720] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:22.805621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:22.805908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:22.806190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:22.829506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:22.830710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:22.908746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:22.926145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 350/721] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:22.968232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132e21-78b6-4ff8-bd78-6a1cc3a8bd37 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:23.090301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132e21-78b6-4ff8-bd78-6a1cc3a8bd37 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:23.133275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ae371-289b-473c-89f7-0f4a4571c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:23.134484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ae371-289b-473c-89f7-0f4a4571c797 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.134992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ae371-289b-473c-89f7-0f4a4571c797 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.135463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ae371-289b-473c-89f7-0f4a4571c797 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.152034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ae371-289b-473c-89f7-0f4a4571c797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cc8ae371-289b-473c-89f7-0f4a4571c797 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:23.160251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:23.161227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:23.162055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:23.165205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 372/722] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:23.172498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:23.184580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743c9a-9c3a-4b6a-99a5-335b51c42a0b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.185133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743c9a-9c3a-4b6a-99a5-335b51c42a0b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.185607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d743c9a-9c3a-4b6a-99a5-335b51c42a0b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.187491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 373/723] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:23.194405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.194915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.195424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.371330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d598cf0-284c-49b4-af95-a97fc19a45b6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:23.385544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:23.386756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:23.424902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:23.425883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.426403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.426878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.427842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:23.428347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:23.430064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:23.440781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 351/724] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:23.448343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:23.457142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:23.511944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 374/725] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:27:23.543838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:23.546707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:23.662689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36437fa1-ac6a-4171-8de9-03a5a6169b47 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:23.683756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505293b-91c1-4a26-aba2-fcd4b0e9e680 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:23.726323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:23.727376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.727840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.728293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.729262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:23.730855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:23.750547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:23.755317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.756104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.757343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.760972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 375/726] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:23 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:27:23.774030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:23.775891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-bfa35eb7-2752-4e56-8a26-cb44f8b0a764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:23.794985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:23.795955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:23.796918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:23.796918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:23.796918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:23.796918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:23.798942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 352/727] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:23.809215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:23.838565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08085e04-c266-49df-b1be-ff2548e34f53 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.838919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08085e04-c266-49df-b1be-ff2548e34f53 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.839131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08085e04-c266-49df-b1be-ff2548e34f53 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.840676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 353/728] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:23.846756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce502b-4722-4eff-9f9d-14e1d6eea564 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:23.847064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce502b-4722-4eff-9f9d-14e1d6eea564 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:23.847312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce502b-4722-4eff-9f9d-14e1d6eea564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:23.864707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:23.873687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b3ce502b-4722-4eff-9f9d-14e1d6eea564 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:23.875017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b3ce502b-4722-4eff-9f9d-14e1d6eea564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:23.984033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9e980-faf5-48b8-9a1f-9e30a5e90e5b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.005752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 354/729] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 05:27:24.007185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0c23-9fc1-4af6-8df0-7101319fda98 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.007575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0c23-9fc1-4af6-8df0-7101319fda98 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.007855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce0c23-9fc1-4af6-8df0-7101319fda98 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.009588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 355/730] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:24.014811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.015099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.015778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.020258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.020967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.021247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.021520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.022250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:24.022558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.024020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.035379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:24.036626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:24.038162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 376/731] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:24.039247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.078137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.120272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 356/732] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:24.121161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.152608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.180704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb124-2f71-4b26-84bd-5d060904adb3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.217934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.218740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.219022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.219323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.231018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:24.239188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:24.240109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:24.241399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 377/733] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:24.242405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.250037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576a15a-44d1-41dc-8cb9-39aca95914de None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.285179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.285985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.286265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.286535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.294249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.295701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:24.311266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:24.313566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 357/734] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:24.315772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.349204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.359428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d3125-028c-48ed-9660-cf9eb592a303 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.397120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.398026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.398314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.398635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.408656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.416012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:24.423895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2acc4-dcd4-4cd0-8f6b-72c6aebd611d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:24.424597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:24.425495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:24.426358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:24.434699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 378/735] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:24.435856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.461232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.462012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.462361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.462696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.463507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:24.463930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.465427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.474967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 358/736] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:24.480569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.548372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c5f6-668b-44c8-92da-45b88dd820ed None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.575998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.585460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2a82-52b3-42ea-b290-8f9946317609 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.587769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.589131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.589594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.590063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.591102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:24.591590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.593237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.616649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 379/737] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:24.618235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.621270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.622024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.622395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.622739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.623974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:24.623974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.625455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.639138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 359/738] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:24.639138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.688465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.735110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012d78-d654-433a-88c0-845bbef8a87a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.744654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b656310-f850-4e8b-a4e6-a917f193ab12 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.776706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.777011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.777506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.777788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.777886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.778060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.778154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.778329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.788541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.789949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.790059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.791390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:24.807245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:24.808138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:24.814487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:24.814487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:24.814487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:24.814487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:24.814487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 380/739] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:24.814487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5c05848f-de3c-45d0-a321-f81f0be7889f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:24.814818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:24.815610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 360/740] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428484-bea0-4fbc-80fb-f326bc02d13f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428484-bea0-4fbc-80fb-f326bc02d13f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428484-bea0-4fbc-80fb-f326bc02d13f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.816531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 361/741] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:24.817849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea428484-bea0-4fbc-80fb-f326bc02d13f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.822886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.926819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea428484-bea0-4fbc-80fb-f326bc02d13f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.932424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8184d1-14e8-4ebd-913a-3bfb7a6d46e9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:24.941787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:24.960877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.961698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.961984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.962258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.962986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:24.963294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.964720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:24.969072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:24.969916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:24.970227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:24.970507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:24.980874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 362/742] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:24.980874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:24.986030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:24.987554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f9660bf9-c98e-44f6-9a80-37d84f58f904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:25.005204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:25.006137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:25.007048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:25.007048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:25.007048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:25.007048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:25.007048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 381/743] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:25.007522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.008055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.008330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.024735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:25.025940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:25.056661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.095814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 382/744] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 05:27:25.096615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.116331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b966821-c75c-4f03-8d1f-81cd1cd6e9ce None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.157541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.158205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.158480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.158746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.159465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:25.159763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.161164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.174341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 363/745] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:25.175149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.194377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.204964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a097517-1be4-4fb4-9e41-0bd6393636b3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.239631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.240694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.240975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.241245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.248468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.249924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:25.264191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:25.265173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 383/746] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:25.266129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.281920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6cc5-565b-4426-9d11-8aa4d78bcda7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.306677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.318668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40586495-fa81-4c65-9804-58f698df69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.319629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40586495-fa81-4c65-9804-58f698df69db None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.319910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40586495-fa81-4c65-9804-58f698df69db None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.320181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40586495-fa81-4c65-9804-58f698df69db None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.320965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40586495-fa81-4c65-9804-58f698df69db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:25.321272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40586495-fa81-4c65-9804-58f698df69db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.322648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40586495-fa81-4c65-9804-58f698df69db None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.334722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 364/747] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:25.335521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40586495-fa81-4c65-9804-58f698df69db None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.377666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e7f1-0cd4-4db7-8664-df1c30e3ae99 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.412136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.412838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.413117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.413385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.414156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.415619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.433469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 384/748] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:25 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:25.434535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.451729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.460820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40586495-fa81-4c65-9804-58f698df69db None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.511429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.512394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.512790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.513135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.521527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.523235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:25.538254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:25.539294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:25.540201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:25.544714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 365/749] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:25.545769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.571947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f83fa-a9b4-4153-909c-6e6576aa8542 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.593567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.616093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.616093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.616093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.616459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.617264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:25.617667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.619144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.638415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 385/750] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:25.639187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.659850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8913b-c5ac-445c-8565-71a137508f7c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.702247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.703073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.703354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.704047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.714377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.715991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.716822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:25.737329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:25.738547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 366/751] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:25.739690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.758411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b48e-371c-4cd8-bc58-697cb6da6c8a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.799343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.800022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.800301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.800647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.801452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:25.801755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.803198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.815683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 386/752] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:25.820604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:25.872792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.876305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2b246-ee64-4d78-b490-9b22abe1c479 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.918188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a22c88-b4a6-45ee-85dc-eafb06ad8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.919190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22c88-b4a6-45ee-85dc-eafb06ad8749 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.919478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22c88-b4a6-45ee-85dc-eafb06ad8749 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.919755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a22c88-b4a6-45ee-85dc-eafb06ad8749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.931093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688609e-e879-45b7-89e6-cfc17e8d82c8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:25.958341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:25.967337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:25.968024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:25.968307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:25.968627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:25.969783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:25.970103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:25.971557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:25.996464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 387/753] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:25.997330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.004015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22c88-b4a6-45ee-85dc-eafb06ad8749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.005523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a22c88-b4a6-45ee-85dc-eafb06ad8749 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.104827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f8f3-ce05-4a11-ae37-826778921935 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.108930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.117895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 367/754] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:26.119415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bac34-c7aa-4d8a-96ef-3ea367abbd22 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.119654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bac34-c7aa-4d8a-96ef-3ea367abbd22 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.119925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bac34-c7aa-4d8a-96ef-3ea367abbd22 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.121354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 368/755] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:26.125994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bac34-c7aa-4d8a-96ef-3ea367abbd22 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.140390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.141320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.141618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.141877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/89e2cefbcf0449ff8fb8b695bba26dd3/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.143849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=89e2cefbcf0449ff8fb8b695bba26dd3, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.145432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.164562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 388/756] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:25 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/89e2cefbcf0449ff8fb8b695bba26dd3/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:26.166775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.224355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.243452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bac34-c7aa-4d8a-96ef-3ea367abbd22 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.283628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.284419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.284788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.285133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.286876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001b1c0-09ad-43ca-adee-4ccfeada54fe None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.324918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.326084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.326603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.327054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.339572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.341502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7b1ad024-1617-4901-9649-23662f7354d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:26.359216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:26.360242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:26.361293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:26.361293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:26.361293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:26.361293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:26.361565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.363814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.364790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 389/757] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:26.365999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.366279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.366391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.366558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.384178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:26.385421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:26.464623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 390/758] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:26.465540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.499399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 369/759] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:26.500584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.509658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.602002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34c46-94c0-478e-b933-d08133fc9eb0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.625654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.629102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec166-5240-44e0-bc41-e8f51cac8e99 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.663169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.665818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.666337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.666727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.667559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:26.667959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.668948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.669634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.670101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.670528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.670942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.671741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.673293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:26.686631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:26.687848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:26.688959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:26.689961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 391/760] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:26.690522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.696702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 370/761] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:26.697858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.807527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff37795-8dba-4f3a-8420-d144df01d244 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.814109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.831761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ac91-9c84-4cab-8189-0723c54db39f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:26.845566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.846627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.847055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.847544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.855146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.856831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.871361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:26.872277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:26.872682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:26.872869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:26.873837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:26.874740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:26.875171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:26.877301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 371/762] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:26.878240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.894166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:26.895998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:26.908680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:26.928145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:26.929173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:26.930613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:26.930613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:26.930613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:26.930613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:26.930613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 392/763] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:26.931096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:26.994706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949ef47-973e-4d9d-a887-9d6238b5504f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.042070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.043017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.043475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.043922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.044855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.045338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.046946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.056620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 372/764] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.057372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff7235-b5e4-4247-87e4-72cc8ece2dac None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.058075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.098769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.099454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.099786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.100058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.101085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.101267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.102727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.112442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:27.116507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 393/765] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.121552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.155743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:27.170463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400937e7-56cc-4d77-836d-6b07b2dd6384 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.212592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.213845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.214388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.214850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.215814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.216310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.217913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.235848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 373/766] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.237372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.246970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420207c3-ed51-4c2d-baa1-04aa26a9303c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.287530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.288212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.288515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.288789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.289718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.290030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.291462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.302204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 394/767] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.302204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.371979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df110f-632a-43e6-b5d0-91a34c5c2cb7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.377972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:27.416502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.416502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.416502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.416502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.416977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c18feb5be4814673933b8e140a91b2a8) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.416977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.417581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.419576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08fc18-d64c-46f4-87a4-733a847a2ef1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.431776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 374/768] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/role_assignments?user.id=c18feb5be4814673933b8e140a91b2a8&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.432803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.462494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.463334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.463617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.463936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.466112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:27.481420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.482979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:27.499596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:27.500625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:27.501513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 395/769] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:27.510537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.627298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8d2ae-81c8-4488-9d0e-f0d38ffc886c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.667346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:27.680557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181631c-a512-49a6-b0a5-6ff34656fb3e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.684067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.684787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.685068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.685338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.686134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.686445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.688413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ada2d-440e-4636-b3da-87b4982a9f79 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.705521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 396/770] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.707207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4833abc-d4a6-4f5b-af02-6f3f6a4db77c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.707736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4833abc-d4a6-4f5b-af02-6f3f6a4db77c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.708019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4833abc-d4a6-4f5b-af02-6f3f6a4db77c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.710626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 397/771] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:27.711420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4833abc-d4a6-4f5b-af02-6f3f6a4db77c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.720154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.720933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.721217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.721489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.722346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] RBAC: Adding query filter params (interface=public, service_id=10243f313e1b40238c0c5b7b92468e15, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.722710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.724118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69004bfc-68b3-4af1-ae8f-240d90c65ffd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.732666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 375/772] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/endpoints?service_id=10243f313e1b40238c0c5b7b92468e15&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.733969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908539c-3aea-429d-9425-28adfc56078b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.734271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908539c-3aea-429d-9425-28adfc56078b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.734547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908539c-3aea-429d-9425-28adfc56078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.751676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d908539c-3aea-429d-9425-28adfc56078b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:27.752941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d908539c-3aea-429d-9425-28adfc56078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:27.832748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 376/773] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:27.833704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908539c-3aea-429d-9425-28adfc56078b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.837619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4833abc-d4a6-4f5b-af02-6f3f6a4db77c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.843822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:27.882836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:27.883433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:27.883716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:27.883994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:27.884861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c0c4748fca7c432197e57f6a2d952fe0) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:27.885177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:27.886632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:27.895144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 398/774] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/role_assignments?user.id=c0c4748fca7c432197e57f6a2d952fe0&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:27.896320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:27.960760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908539c-3aea-429d-9425-28adfc56078b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:27.971654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:28.008269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.010904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.011186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.011463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.012166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:28.013632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:28.033779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 377/775] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:28.063622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a348662-2efc-4aec-b885-7ef35a7b9b69 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:28.112180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.113066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.113348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.113619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] PATH_INFO: `/v3/services/network` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.114296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:28.115737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:28.136418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:28.138727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:28.140734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 399/776] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:27 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:28.149917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:28.248846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:28.286795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2f016-8b41-4bbe-8eeb-fd0aeff068f4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:28.327184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.327883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.328161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.328439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.329193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] RBAC: Adding query filter params (name=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:28.329498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:28.330896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f43e8a-030e-46d1-8120-82900aea8f8e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:28.336542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 378/777] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:28.342334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:28.399144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d9ac-6718-489c-bbe5-a4b0c643baf6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.399322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d9ac-6718-489c-bbe5-a4b0c643baf6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.399601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2d9ac-6718-489c-bbe5-a4b0c643baf6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.401264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 379/778] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:28.406665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.407241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.407722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.433170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:28.434719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:28.461224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ec2b2-bce5-4937-81a5-7eb865c5dd6c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:28.493087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:28.506437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.507125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.507410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.507687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.508805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:28.509384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:28.511678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:28.516869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 400/779] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:28.522545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:28.545984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 380/780] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:28.570015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:28.643398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:28.686223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f9bea-f461-47cd-a033-0d9af06ca11d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:28.727023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.727836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.728112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.728378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.747997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:28.755610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:28.756575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:28.757416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:28.760402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 381/781] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:28.766386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39679631-ab79-4d98-b8b4-448beb261cf6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:28.769437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:28.833010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.834337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.834814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.835466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.837154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] RBAC: Adding query filter params (interface=public, service_id=4090f2a300a34b3da32fc2963d036035, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:28.837683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:28.839949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:28.849063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 401/782] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/endpoints?service_id=4090f2a300a34b3da32fc2963d036035&interface=public®ion_id=RegionOne => generated 194 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:28.861588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:28.890774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ede8-d510-4209-8432-7e22728997c3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:28.917671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:28.945755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:28.946350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:28.946628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:28.947022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:28.948029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:28.948932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:28.949245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:28.950700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:28.974011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 382/783] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:28.976396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:29.061709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b335c8-3f19-4eeb-b30e-0cd758b06840 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:29.107226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc749-1172-4e67-a0a4-fb356f175792 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:29.125582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:29.126492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.126914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.127350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.129716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:29.131248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:29.141565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 402/784] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:29.169325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:29.170690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.171169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.171584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.184312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:29.185984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:29.211909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:29.213072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:29.214176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:29.214176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:29.214176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:29.214176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:29.220548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 383/785] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:29.222033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:29.352020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42902da2-08c4-4b8b-9d52-8c96389c24f5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:29.357541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:29.411949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:29.412987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.413411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.413849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.414802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:29.415248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:29.416848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:29.442036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 403/786] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:29.448411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:29.496625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:29.560220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ab218-7d43-49ca-b2a2-be9eeae8907e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:29.595133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:29.595937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.596213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.596519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.604571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:29.606024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-58636c4a-f32d-4650-9845-869db976c08b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:29.620053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:29.621037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:29.621975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 384/787] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:29.630531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:29.639966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452c85-9e88-4246-9ebf-beabb7be5655 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.640252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452c85-9e88-4246-9ebf-beabb7be5655 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.640564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452c85-9e88-4246-9ebf-beabb7be5655 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.641928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 385/788] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:29.646898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.647183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.647460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.680045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:29.681269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:29.802541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 386/789] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:29.804391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827c634-a11c-4b7c-a52d-0e2241aa576f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:29.854654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:29.869484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:29.870174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:29.870456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:29.870732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:29.871580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:29.871894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:29.874936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:29.903388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:29.910341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 404/790] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:29.913840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:29.956525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.026902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b173e7-f78c-4bcb-b575-18a4a61092c0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.068201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.069315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.069597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.069871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.090050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:30.097792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:30.098710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:30.099544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 387/791] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:30.106698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.124531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9c70f-86f5-4315-b0fc-79dda141451a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.186152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.187224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.187871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.189648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.257801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.282910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3c2a-58ae-4c8f-9088-ba9e9605d77b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.313273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:30.315096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:30.346299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.348351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.349044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.350164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.351308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:30.354699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:30.356100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:30.367729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 388/792] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:30.374361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.380853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.473920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 405/793] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:30.485989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.501768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971479f-468e-428a-adb6-6324ac50f442 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.559463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9509082-876a-4df1-afe8-53236209446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.560688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9509082-876a-4df1-afe8-53236209446b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.561116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9509082-876a-4df1-afe8-53236209446b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.562291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9509082-876a-4df1-afe8-53236209446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.575982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9509082-876a-4df1-afe8-53236209446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:30.577911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9509082-876a-4df1-afe8-53236209446b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:30.590426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229f1-2255-4a50-b390-8b9f109e6acb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f9509082-876a-4df1-afe8-53236209446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:30.599909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:30.601026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:30.602080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:30.602080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:30.602080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:30.602080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:30.608307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 389/794] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:30.609844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c224-359d-4b2c-8fc6-f56fb6275c28 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.610309 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c224-359d-4b2c-8fc6-f56fb6275c28 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.610583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c224-359d-4b2c-8fc6-f56fb6275c28 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.611895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 390/795] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:30.612936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300112e7-4cf1-41bf-9c0e-2494c1805bc7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.613215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300112e7-4cf1-41bf-9c0e-2494c1805bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.613489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300112e7-4cf1-41bf-9c0e-2494c1805bc7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.618946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 391/796] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:30.618946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300112e7-4cf1-41bf-9c0e-2494c1805bc7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.619187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.620501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.632178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.633046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.633324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.633597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.644316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:30.646291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f67641b5-6ad1-4b4d-913c-5738b9321903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:30.663413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:30.664356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:30.665288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:30.665288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:30.665288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:30.665288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:30.665288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 406/797] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:30.666288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ade83-3218-4d15-b59f-6a5a8a44cc27 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.666288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ade83-3218-4d15-b59f-6a5a8a44cc27 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.666463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ade83-3218-4d15-b59f-6a5a8a44cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.684787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-316ade83-3218-4d15-b59f-6a5a8a44cc27 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:30.686029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-316ade83-3218-4d15-b59f-6a5a8a44cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:30.740025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300112e7-4cf1-41bf-9c0e-2494c1805bc7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.756883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 407/798] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:30.758514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.759158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.759609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.776555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:30.778121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:30.791363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.792046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.792330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.792651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.793695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:30.793695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:30.795067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:30.807819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 392/799] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:30.808609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.852705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 408/800] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:30.853458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.883656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.887183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:30.925554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af2f98-9915-499e-a2f6-c8c2bbfee80a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.954909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82842-0c69-4814-b2ac-6714f8e2b3df None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:30.961600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.962671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.962964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.963225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:30.964296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:30.964640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:30.966328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:30.977956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 393/801] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:30.978566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:30.996233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:30.997114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:30.997400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:30.997680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.008212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:31.015983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:31.017130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 409/802] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:31.018031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.084225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c1894-f713-4ab0-b93c-6cb6d9e5a8a7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.108458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.121207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.122012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.122291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.122555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.122653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.129903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdc0b1-d3a0-4e35-9221-a4cc03139052 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.131022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.132940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:31.146553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:31.147499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:31.148528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 394/803] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:31.149121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.170392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.171213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.171541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.171952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.172689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.174180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:31.186847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:31.187852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 05:27:31.188713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:31.193008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 410/804] 10.222.0.18 () {56 vars in 1129 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:31.194270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.254586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5613-7ba8-4d45-b40c-0d4a825eb883 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.290452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.291495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.291957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.292227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.299078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.300557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.301346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c5e7b-59fd-44ab-bb9a-234b81d03894 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:31.314640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:31.315546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:31.316449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 395/805] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:31.317760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.340112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.340809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.341085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.341357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.342095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.342397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.344058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.352268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 411/806] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.352908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.371327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.377060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.436662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ce46-eec6-4262-a3d5-265951b77a1d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.466143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c40a-616a-47f3-b3d1-6c7e597f6303 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.473052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.474137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.474420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.474698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.475900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.476217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.478025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.499412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 396/807] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.499412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.505657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.506420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.506706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.507000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.507732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.508040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.509559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.514323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 412/808] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.518916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.601890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.604962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.605386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820da6f5-e0d4-4786-804e-571427664b12 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.622627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab5b7d-d90a-4463-a610-2df97409c1a1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.641135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.641831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.642101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.642382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.643171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.643481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.644960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.656292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.656631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 397/809] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.657132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.657414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.657509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.657721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.672574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.674054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:31.690722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:31.691705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:31.692644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:31.692644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:31.692644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:31.692644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:31.692644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 413/810] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:31.692932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.756237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13794d45-ecd1-4c7b-bb99-2cc9e0b8a8d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.787821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.788629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.788907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.789229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.793067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489588e9-80e1-4739-be3d-c8db3413dc36 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.799388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.800855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7a9eb0ef-1961-4dc6-82ff-6c5c85c8d0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:31.817229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:31.818287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:31.819728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:31.819728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:31.819728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:31.819728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:31.819728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 398/811] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:31.820396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c6559-2abb-4e17-9eff-3f48ec2f0e42 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.820700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c6559-2abb-4e17-9eff-3f48ec2f0e42 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.820966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c6559-2abb-4e17-9eff-3f48ec2f0e42 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.822201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 399/812] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:31.825205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c6559-2abb-4e17-9eff-3f48ec2f0e42 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.831350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.832018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.832294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.832586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.833285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.833570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.835326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.837822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.841467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:31.842246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 414/813] 10.222.0.18 () {56 vars in 1124 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.843123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.930841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c6559-2abb-4e17-9eff-3f48ec2f0e42 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.940716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6125b-e642-4c8d-83a5-abe0bccd4206 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:31.963819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.964585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.964885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.965154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.965971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=89e2cefbcf0449ff8fb8b695bba26dd3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.966279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.967709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.973334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 400/814] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/role_assignments?user.id=89e2cefbcf0449ff8fb8b695bba26dd3&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.974093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:31.974189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:31.974795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.975078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.975353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:31.976068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:31.976374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:31.977855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592ffd7-d9a1-4ffb-a412-dd9762b5960f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:31.991020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 415/815] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:31.994748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:31.995059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:31.995305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.012935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:32.014154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:32.076248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.083231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.097250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 416/816] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:32.098462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.111694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5be3b-bb80-4d71-b0dc-bc5fda64fb4e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.153434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.154108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.154386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.154655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.155372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:32.155680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.157095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.172103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 401/817] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:32.173540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.225779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860ddd-b29d-456d-8e34-f4c7c8a84fc1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.265914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.266586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.266931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.267143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.267870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.269297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.285812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955f95-5cf8-4126-ab4a-03a7dd028e69 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.300510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 417/818] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:32.300510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.332162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.337206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.338492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.338853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.339481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.353235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.355596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.363135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:32.383662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:32.384776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:32.385714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:32.392427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 402/819] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:32.393461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.436835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd2a59-b8a3-489b-aee1-f2a1e515ba6d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.479473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.480210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.480514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.480796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] PATH_INFO: `/v3/services/network` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.481453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.482842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:32.498760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:32.499798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:32.500757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 418/820] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:32.502161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.541117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6fa30-f5f6-4624-ab50-1726ef9fd970 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.591522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.592329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.592637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.592913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.603181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.606383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:32.628369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:32.629330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:32.630258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:32.630693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb334-f119-42e5-a08b-282da4cd9262 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.634101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 403/821] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:32.635136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.642006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.671989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.672706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.673013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.673280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.674135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:32.674433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.676007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.699708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 419/822] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:32.699708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.725186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.792519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e29bd-5d4a-4d70-91d0-3e1d756bb296 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.806070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039024c-bfec-4d96-828d-5f266aeb8a4d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.834383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.835350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.835686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.836035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.837233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:32.837671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.839450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.845123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.845379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 404/823] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:32.846187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.846303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.846812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.847251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.848182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:32.848674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:32.850347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:32.863017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 420/824] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:32.864151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:32.903290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.956960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde07f28-b56a-41b7-8cfc-8333640ddcb4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:32.974288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:32.993968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:32.995042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:32.995470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:32.995891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:32.999096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f8b9b-fba8-487f-92be-60dde73ce50d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.008076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.010032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:33.028140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:33.029072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:33.029968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:33.029968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:33.029968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:33.029968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:33.031887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 405/825] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:33.037291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:33.042460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.043227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.043456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.043728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.044515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] RBAC: Adding query filter params (type=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:33.044823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.046261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.053361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 421/826] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:33.054576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:33.158199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:33.168959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fe1f6-442d-4fba-b59f-0952674fa66f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.173648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8539a-a96b-4f02-9276-75d5101d50be None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.204795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.205609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.206055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.206437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.207299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:33.207698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.209313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.216391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.217840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.218114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.218389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c18feb5be4814673933b8e140a91b2a8/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.221245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=c18feb5be4814673933b8e140a91b2a8, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.222206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 422/827] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:33.222770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.223011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:33.244002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 406/828] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:33 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c18feb5be4814673933b8e140a91b2a8/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:33.244954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:33.282845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:33.400836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566f61a-6b90-4088-a012-b2e466a124da None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.485736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.486432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.486814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.487092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.487955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.489417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.493680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494406-d61e-4a9d-addb-feca09a66061 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.533009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.534015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.534293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.534564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.542690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.543801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 423/829] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:33.544288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:33.559741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:33.560764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:33.561736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 407/830] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:33.567209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:33.585070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:33.714940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcb731-1b31-40cc-8338-c114e4cdf50d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.751892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.752637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.752923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.753202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.754387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:33.754491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.755934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411274be-a296-465a-b44c-7d4eff04f22f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.768738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 424/831] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:33.774762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:33.866770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:33.879855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5382cf-9fc8-4f00-a7ea-aa53a9ebdaf0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:33.915759 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f9fa7-a09f-469c-9449-e96f19af2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:33.916691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f9fa7-a09f-469c-9449-e96f19af2904 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:33.916972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f9fa7-a09f-469c-9449-e96f19af2904 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:33.917248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f9fa7-a09f-469c-9449-e96f19af2904 None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c0c4748fca7c432197e57f6a2d952fe0/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:33.934852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f9fa7-a09f-469c-9449-e96f19af2904 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=c0c4748fca7c432197e57f6a2d952fe0, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:33.936309 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f9fa7-a09f-469c-9449-e96f19af2904 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:33.953598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 408/832] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:33 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c0c4748fca7c432197e57f6a2d952fe0/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:34.204684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b248b2-7bbd-44b3-a304-2d1140f9523c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.205711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b248b2-7bbd-44b3-a304-2d1140f9523c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.206227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b248b2-7bbd-44b3-a304-2d1140f9523c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.208053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 425/833] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:34.213653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.213940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.214243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.231134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:34.232319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:34.304947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 409/834] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:34.327108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b248b2-7bbd-44b3-a304-2d1140f9523c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:34.390411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:34.432286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b248b2-7bbd-44b3-a304-2d1140f9523c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:34.467891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:34.468671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.468952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.469224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.469873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:34.471251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4e3e378a-1cfc-403f-98cf-e33f36277b73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:34.483182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:34.484112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:34.484972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 426/835] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jul 21 05:27:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:34.490602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:34.557817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:34.592720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08637784-cb59-47a0-b21c-0fcf1033fe88 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:34.598375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63189e82-3b6f-4fe5-91ef-7ea5604ebf94 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.598656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63189e82-3b6f-4fe5-91ef-7ea5604ebf94 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.598932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63189e82-3b6f-4fe5-91ef-7ea5604ebf94 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.604237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 427/836] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:34.605715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.605996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.606363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.628381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:34.630580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:34.636580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:34.637266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.637547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.637818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.638521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:34.638826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:34.640201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:34.648524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 410/837] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:34.650814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:34.708550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 428/838] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:34.733987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:34.766030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edb11b-c3ae-4cb6-8468-70a50f23bac9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:34.797351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:34.800979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:34.801622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.801877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.802153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.802919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:34.803615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:34.805600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:34.816523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 411/839] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:34.820505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:34.857690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0722a-2d00-4fcb-a924-7ac6d83c0a6e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:34.898667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:34.899490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:34.899772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:34.900044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:34.900730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:34.902139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:34.914907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:34.915975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:34.916845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 429/840] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:34.924028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:35.030095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5effeea-73ba-473b-9fc0-1601102bb4f4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:35.064462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:35.065454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:35.065928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:35.066366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:35.067231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:35.067701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:35.069647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cda9c-60dc-4d92-83bd-111571f49299 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:35.074936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 412/841] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:35.080798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:35.186999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009c1df-142b-4d80-81ca-fd9d922eb373 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:35.210879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:35.224723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:35.225665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:35.226116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:35.226589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:35.227458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:35.227941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:35.229512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144682de-096d-4793-9fcb-02bc4a20a8ed None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:35.238435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 430/842] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:35.601862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752062e-55b7-403e-9a6e-276397f73f2c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:35.602247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752062e-55b7-403e-9a6e-276397f73f2c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:35.602419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752062e-55b7-403e-9a6e-276397f73f2c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:35.604019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 413/843] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:35.609970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:35.610265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:35.610546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:35.627365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:35.628571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:35.700108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 431/844] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:35.723479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752062e-55b7-403e-9a6e-276397f73f2c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:35.787586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:35.833350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752062e-55b7-403e-9a6e-276397f73f2c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:35.868333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:35.869440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:35.869859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:35.870265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:35.881199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:35.888862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:35.890000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:27:35.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:35.893400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 414/845] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:35.899280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:35.999712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c546-4c03-4134-bd4e-68ae4a87eda8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.018263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.036343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.037056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.037339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.037612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.038355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:36.038659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.040138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65e4ff-d18e-4786-a53f-deacaa1edb3c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.048777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 432/846] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:36.054582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.099588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7758-2d5b-4389-9921-8c68e83202a9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.100429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7758-2d5b-4389-9921-8c68e83202a9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.100881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7758-2d5b-4389-9921-8c68e83202a9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.103070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 433/847] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:36.107970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.108533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.109032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.127819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:36.130302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:36.162534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d2bf8-11e5-4ed2-9900-26f3ebb917c8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.187453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.203322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.204446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.204972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.205469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.216846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 434/848] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:36.217425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.219103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.231751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:36.237588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:36.238459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:36.239334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:36.239334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:36.239334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:36.239334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:36.241537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 415/849] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:36.247266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.332162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87bac0-d613-4df1-9680-9933deb0494f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.343675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.354915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026669c-6e8e-450e-a73b-13823b5406e2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.371421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.372230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.372514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.372786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.383573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:36.391742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:36.392707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:27:36.393560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:36.395420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.396340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.396840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.397360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.397980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 435/850] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:36.398859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:36.398991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.399519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.401139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.419363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 416/851] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:36.422096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.456596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.506220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def787f8-16d1-4ef1-aab6-06b61b613bcd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.529435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223cb84-59ab-4190-9aa9-aa992fdb413c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.547063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.547733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.548009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.548280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.549143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:36.549449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.550925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.564566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 436/852] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:36.566336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.569311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.570459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.570937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.571407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.579255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.580995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:36.595940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:36.596896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 05:27:36.597961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:36.598506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.605299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 417/853] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:36.606413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.673361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992b681-cd29-4dee-9b58-dd27129cfea2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.699582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.708896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25887-8271-4e9d-85c6-75c4e400c516 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.711839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.713213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.713213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.713423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.724833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.726431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:36.744646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:36.745585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:36.746488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:36.746488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:36.746488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:36.746488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:36.748546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 437/854] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:36.751417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.754169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.754992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.755393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.755787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.757499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:36.757499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.758762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.782514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 418/855] 10.222.0.18 () {56 vars in 1135 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:36.783534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.850826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.875685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6a418-2ee7-4153-8127-f48a7f575e2a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.889751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ca969-e63a-4acd-af99-492dfcc75dc6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:36.913046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.914191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.914613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.915063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.915990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:36.916421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:36.918059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786cca5-c3f6-4852-93f0-e0606d1ded05 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:36.926583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46894270-c213-4973-9fe0-bbe800f70ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:36.927074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46894270-c213-4973-9fe0-bbe800f70ebc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.927454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46894270-c213-4973-9fe0-bbe800f70ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.927883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46894270-c213-4973-9fe0-bbe800f70ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.936824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 438/856] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:36.938171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fa523-8ddc-4f8f-b3bf-d82035a122f6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:36.938460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fa523-8ddc-4f8f-b3bf-d82035a122f6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:36.938733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fa523-8ddc-4f8f-b3bf-d82035a122f6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:36.940143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 439/857] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:36.944317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fa523-8ddc-4f8f-b3bf-d82035a122f6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:36.948454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:36.999514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46894270-c213-4973-9fe0-bbe800f70ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.001097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46894270-c213-4973-9fe0-bbe800f70ebc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.051388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fa523-8ddc-4f8f-b3bf-d82035a122f6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.087210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.088259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.088715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.089294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.096832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.098531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.106136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 419/858] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:37.106136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.106136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.106136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:37.113982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:37.114929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 440/859] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:27:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.121012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.128880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:37.130442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:37.185217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.212529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 420/860] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:37.212529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.239239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa935d31-852d-4062-85e4-4c1ef7bfaddc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.275989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.276818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.277103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.277682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.288108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.289612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:37.306660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:37.307659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:37.308630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:37.308630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:37.308630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:37.308630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:37.308630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 441/861] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:37.308630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.311835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf43f0a-e559-4d42-a911-3fa21063d1a3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.345376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.346042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.346318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.346580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.347421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:37.347720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.349207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09721b3-29ba-4974-8e6c-f41501a0c926 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.365852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 421/862] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:37.367094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3736ea-4aa7-462f-9961-58077e897b66 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.367378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3736ea-4aa7-462f-9961-58077e897b66 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.367647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3736ea-4aa7-462f-9961-58077e897b66 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.368573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.368883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 422/863] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:37.369756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3736ea-4aa7-462f-9961-58077e897b66 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.410458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.419022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cae2-5daf-404d-8459-79f97ca2e67d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.452149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.452853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.453135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.453403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.454137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.455536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.469192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 442/864] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:37 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:37.469996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.497133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3736ea-4aa7-462f-9961-58077e897b66 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.535848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.536762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.537044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.537589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.538055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:37.538360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.539817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570cd15-a8bc-4d06-b30d-7c619368e75f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.557436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 423/865] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:37.557436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.557436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.557436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.574834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:37.576047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:37.584425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5f30-8d76-40f0-afdb-c56e85b3bf6c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.600241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.627583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.628172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.628453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.628756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.656367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 424/866] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:37 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:37.657345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.690936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.706819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.708296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.772311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8697e-91e5-40c8-88ad-0c8b305cbf8b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.807396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.808204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.808505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.808817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.810623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 443/867] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:37.813530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.816358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.818044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.831136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:37.832506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:37.833818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:37.834917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:37.838592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 425/868] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:37.839435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.920317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c932b63-d5f7-49c6-a878-07f2f7865611 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.928982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:37.946264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32bc0b-5f0e-4e5d-85a8-a1ec4da0d2dd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:37.955157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:37.955893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:37.956098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:37.956362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:37.957112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:37.958493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:37.972300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 444/869] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:37 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:37.973131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:37.999975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.001455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.001738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.002009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.021978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.023924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:38.047494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:38.048515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:38.049417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:38.049417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:38.049417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:38.049417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:38.052951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 426/870] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:38.055117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:38.079460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:38.117959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb827b-a27e-45f6-b00a-5c0e1a07c9a5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:38.165011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.166279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.166925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.167357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.168507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:38.168819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.170284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.174364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae4a3-0c44-4cc5-bb15-5c07e4750a03 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:38.184178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 445/871] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:38.189945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:38.208963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:38.215423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.217249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.217249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.217249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.217983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:38.218292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.219701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.233365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 427/872] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:38.242041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:38.323082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0b31b-9161-4112-8763-ee41e62d7ce5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:38.350278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1601f5-0392-4cc3-9374-ba1905d040bf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:38.367433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.368321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.369033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.369548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.370888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c18feb5be4814673933b8e140a91b2a8) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:38.371342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.373436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.375766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:38.383479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 446/873] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:38 2022] GET /identity/v3/role_assignments?user.id=c18feb5be4814673933b8e140a91b2a8&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:38.396524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.397455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.397742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.398009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.406674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.408375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:38.424629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:38.425749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:38.427346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:38.429895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 428/874] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:38.435763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:38.557967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d98735-80eb-44b3-bab1-15dfe90764cf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:38.593617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.594301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.594581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.594856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.595658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:38.595973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.597493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef788dd-8215-4955-a496-77f27195537d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.612422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 447/875] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:38.618701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:38.681269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:38.723519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f409d-805b-4f0c-a468-d3f0bfacb8ff None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:38.758536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:38.759211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:38.759547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:38.759822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:38.760739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c0c4748fca7c432197e57f6a2d952fe0) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:38.761058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:38.762510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0f345-f128-402a-ad0b-b896c58d74d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:38.769208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 429/876] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:38 2022] GET /identity/v3/role_assignments?user.id=c0c4748fca7c432197e57f6a2d952fe0&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:39.525610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80dccb-1b81-4779-aa70-0b402aeae476 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:39.526152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80dccb-1b81-4779-aa70-0b402aeae476 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:39.526152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80dccb-1b81-4779-aa70-0b402aeae476 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:39.527924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 448/877] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:39.534152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:39.534705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:39.534705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:39.552148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:39.553386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:39.632593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 430/878] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:39.649520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80dccb-1b81-4779-aa70-0b402aeae476 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:39.713654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:39.756449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80dccb-1b81-4779-aa70-0b402aeae476 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:39.790836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251008d9-6223-4945-acec-c59bf311bded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:39.792020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251008d9-6223-4945-acec-c59bf311bded None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:39.792554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251008d9-6223-4945-acec-c59bf311bded None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:39.793081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251008d9-6223-4945-acec-c59bf311bded None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:39.793944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251008d9-6223-4945-acec-c59bf311bded None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:39.795575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251008d9-6223-4945-acec-c59bf311bded None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-251008d9-6223-4945-acec-c59bf311bded None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:39.808455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:39.809416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:39.810283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:39.813182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 449/879] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jul 21 05:27:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:39.824544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:39.881296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:39.921293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba383f-2443-43eb-bb63-9828a90b326b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:39.957507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:39.958208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:39.958487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:39.958762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:39.959489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:39.959795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:39.961437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:39.971888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 431/880] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:39.973228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251008d9-6223-4945-acec-c59bf311bded None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.073599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251008d9-6223-4945-acec-c59bf311bded None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.095748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:40.107897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.108599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.108883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.109158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.109858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:40.110166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.111542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef37daf-571a-4494-869e-b7852bcf564c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.120608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 450/881] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:40.122995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.191835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3280432-94a1-4c6a-80ea-7442baf2bf06 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.192185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3280432-94a1-4c6a-80ea-7442baf2bf06 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.192451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3280432-94a1-4c6a-80ea-7442baf2bf06 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.194901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 451/882] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:40.200031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.200314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.200607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.218820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:40.220087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:40.228577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfc629-1933-4151-998b-e93dfde3957f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.240266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:40.264307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.265002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.265283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.265552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.266344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] RBAC: Adding query filter params (interface=public, service_id=0f50ff1cf8954e9c98021447c00d7f26, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:40.266653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.268141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.278181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 432/883] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/endpoints?service_id=0f50ff1cf8954e9c98021447c00d7f26&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:40.279516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.308856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 452/884] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:40.330211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.390518 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8311-2149-47cb-932e-0e530f733ed4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.438633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.439457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.439830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.440197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.441448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.442836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.455884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e392546-1287-49b8-aef0-7028b66b4c06 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.456660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 433/885] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:27:40.476274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:40.496785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.497848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.498299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.498715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.499532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.501154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-582db8e6-55aa-44d1-9f9e-e195fbb1972f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:40.514372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:40.515683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:40.516795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:40.519356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 453/886] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:40.525696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.566350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393edfc-fc7f-4463-8b55-64986cf93005 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.567261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393edfc-fc7f-4463-8b55-64986cf93005 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.567682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393edfc-fc7f-4463-8b55-64986cf93005 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.570354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:40.571067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 454/887] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:40.577143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.580081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.580081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.596813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:40.598421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:40.637311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850a6f8-86e7-4579-8c77-2500dd35b0f3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.680282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.681430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.681922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.682341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.683207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:40.683629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 455/888] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:40.683932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.689532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.696196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 434/889] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:40.704543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.711465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.819330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450325f0-b2ff-4af2-a827-70bdae3dafe7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.830164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1566899-b29a-42a3-855c-89600d4337fb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:40.831773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:40.833311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:40.858534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.859582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.860095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.860555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.861576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:40.861891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.863293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.873406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 456/890] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:40.874754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.882306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:40.883537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.884024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.884556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.885921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:40.887926 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3408b7e3-ec8e-4e36-b12e-514d97c8cb10 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:40.902984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:40.904025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:40.905345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 435/891] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:40.906140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c899ee9-5583-4719-a472-98d6380bc14a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:40.906140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c899ee9-5583-4719-a472-98d6380bc14a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:40.906140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c899ee9-5583-4719-a472-98d6380bc14a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:40.907293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 436/892] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:40.911077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c899ee9-5583-4719-a472-98d6380bc14a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:40.984237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ad59-8134-491e-9724-56b429399b89 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.018975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.019649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.019931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.020031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c899ee9-5583-4719-a472-98d6380bc14a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.020203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.021015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] RBAC: Adding query filter params (interface=public, service_id=2d3b9ec9d2a54178b247aa5158d51202, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:41.021331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.022723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148403f-3914-4a35-815a-f4f6552ba5f3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.028045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 457/893] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/endpoints?service_id=2d3b9ec9d2a54178b247aa5158d51202&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:41.029367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.029656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.029929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.046436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:41.047626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:41.062400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.062885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.063167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.063436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.064145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:41.064451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.065842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.071501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 437/894] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:41.072055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.084741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:41.104201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:41.126934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 458/895] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:41.127957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.187175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1973c9-fcfe-4de9-87b0-ef1e0bd6030a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.222030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.222706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.222962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.223267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.223939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.225350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.240511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 438/896] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:27:41.240511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.260527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02432e-51de-4c30-868e-a8b8115ff2df None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.312224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.313372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.313788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.314990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.315732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:41.316047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.317520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.324988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 459/897] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:41.349051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:41.358084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeb1a4-a4fc-4f43-bb8b-bdcac370be19 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.398070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.398961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.399251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.399532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.412134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:41.420668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:41.421674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:41.422505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 439/898] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:41.428260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.473022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:41.536543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619f782-3041-4652-bc42-d04b4b9f7e0c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.572973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.574469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.574949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.575463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.576420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:41.576938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.578507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.587999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 460/899] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:41.593347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.700661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315fc7-cd45-4ae9-a3a5-3e8ce992a83d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.735441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.736258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.736585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.736863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.748963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.750432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:41.768052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:41.769002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:41.769959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:41.769959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:41.769959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:41.769959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:41.769959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 440/900] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:41.775148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.873167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:41.880098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369abfe-3001-43e2-9809-60869b2e5d3e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:41.914946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:41.916011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:41.916515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:41.916982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:41.917892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:41.918387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:41.919973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:41.932081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 461/901] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:41.937493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:41.947599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:42.042908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b371ecb-5e14-471b-a5f2-5bc59b00770e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:42.078946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:42.079776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.080055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.080327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.088349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:42.090269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:42.105056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:42.106082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:42.107111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 441/902] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:27:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:42.112731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.217008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cd25d-7adc-4298-b667-3a076d84ce05 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:42.251279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:42.252291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.252800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.253267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.254323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:42.254825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:42.256644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f456a16-7c29-4507-a146-28031e319925 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:42.274693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 462/903] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:42.280502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.353387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:42.389353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8e167-5a47-4508-8e2b-a3738f1faa5c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:42.427189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:42.427868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.428156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.428669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.501915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:42.503306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:42.570847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:42.572977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fec3d-1256-4e19-8a8f-fb58d6656cd2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.573472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fec3d-1256-4e19-8a8f-fb58d6656cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.573577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fec3d-1256-4e19-8a8f-fb58d6656cd2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.575097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 463/904] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:42.580635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.581169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.581641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.599807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:42.601493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:42.609169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 442/905] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:42.610366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:42.624502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.672921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 464/906] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:42.696060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.724927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c108-7442-431c-8f50-b81709f608e3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:42.761333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:42.762326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.762692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.763028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.775937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:42.778175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:42.801364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:42.802286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:42.803474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:42.803474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:42.803474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:42.803474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:42.803698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac134df-2af1-48e0-9ce7-f8ce4add56fb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:42.807563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 443/907] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:42.808495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.839415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:42.843243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:42.844229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.844614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.844955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.845698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:42.847153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:42.861197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:42.862152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:42.863373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 465/908] 10.222.0.18 () {56 vars in 1132 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:42.871582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.884132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:42.913588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d320e-c609-4adc-a3ec-ebdd768fc48c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:42.960388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:42.961288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:42.961685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:42.962051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:42.962877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:42.963316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:42.965212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:42.984569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 444/909] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:42.988171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:42.995878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38febb9d-f174-401b-9f72-94a5e3cea742 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.042053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.043625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.044114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.044824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.045777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:43.046476 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.048734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.056106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 466/910] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:43.069788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.075271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.099432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bede35-d9a4-439e-94a5-d1c7b40bd164 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.141770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.143103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.143539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.143952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.150148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.152998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.154733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:43.171651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:43.172655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:43.173791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 445/911] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:43.180131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.196080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1831dc-7348-4634-89e6-7a1c55663a64 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.233137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.234188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.234667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.235136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.236135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:43.236663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.238299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.244386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 467/912] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:43.250445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.296227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4254e-318c-4f43-b62c-0f5a00de8d31 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.338922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.339997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.340495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.341343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.342348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:43.343170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.345413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.353775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.367412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 446/913] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:43.369468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.373088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cfc8b-bd6a-485d-9ae1-b8d9bde68ae5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.416659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ef25b-5ae2-4f6a-9e22-6fd1c684e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.417334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ef25b-5ae2-4f6a-9e22-6fd1c684e630 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.417607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ef25b-5ae2-4f6a-9e22-6fd1c684e630 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.417878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ef25b-5ae2-4f6a-9e22-6fd1c684e630 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.418620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ef25b-5ae2-4f6a-9e22-6fd1c684e630 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.420010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ef25b-5ae2-4f6a-9e22-6fd1c684e630 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.426176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.440530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 468/914] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:27:43.442253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd32ea-b206-4a3e-aa2b-6a778c0ba702 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.442604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd32ea-b206-4a3e-aa2b-6a778c0ba702 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.442943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd32ea-b206-4a3e-aa2b-6a778c0ba702 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.444803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 469/915] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:43.450574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375197-99e5-4853-91e2-915b1716473c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.450867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375197-99e5-4853-91e2-915b1716473c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.451141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b375197-99e5-4853-91e2-915b1716473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.469688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4b375197-99e5-4853-91e2-915b1716473c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:43.470997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4b375197-99e5-4853-91e2-915b1716473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:43.529075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08077dc-bcb1-425b-b3ee-76ad6a85e6fb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.556689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 470/916] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:43.558054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d0f33-5cdc-4c81-a437-9c103bda3d94 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.558337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d0f33-5cdc-4c81-a437-9c103bda3d94 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.558612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d0f33-5cdc-4c81-a437-9c103bda3d94 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.560123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 471/917] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:43.566037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.566665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.567568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.579325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.580017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.580300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.580611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.581490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] RBAC: Adding query filter params (role.id=8f395d2379474151a4ad98613ebc69b7, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c0c4748fca7c432197e57f6a2d952fe0) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:43.581788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.583279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.588434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:43.589755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:43.596695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 447/918] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:43 2022] GET /identity/v3/role_assignments?user.id=c0c4748fca7c432197e57f6a2d952fe0&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=8f395d2379474151a4ad98613ebc69b7 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:43.598249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.675389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 472/919] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:43.696912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.699465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.739510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f29a6-e74e-42f5-98a6-8c178fb989fa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.777319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.778191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.778409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.778680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.779339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.780751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.781007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:43.793483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:43.794563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:43.795404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 448/920] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:43.800619 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:43.845454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752a5f8-dcfb-473f-94ce-fa68da6c4477 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.882188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.882798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.883083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.883358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.884160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.885736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.916708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 473/921] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:43 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:43.939177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae5a32-e715-4545-a67f-37ac4c361d8b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:43.970013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:43.986685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:43.987422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:43.987836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:43.988118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:43.988917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:43.989231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:43.990696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:43.996684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 449/922] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:44.003202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:44.123818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692d3f-5250-4e15-852c-c8473bb8a5a6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:44.131082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:44.159280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:44.159966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:44.160249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:44.160546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:44.161260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:44.161566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:44.162953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0fe19-bcd0-4b3c-915b-c12e095fd56f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:44.173965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 474/923] 10.222.0.18 () {56 vars in 1114 bytes} [Thu Jul 21 05:27:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:44.180229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:44.285201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5e94-6672-4f12-badf-7b455c2992f2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:44.321403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8796b9-f173-4ed0-97f7-76b227706f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:44.322508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8796b9-f173-4ed0-97f7-76b227706f3b None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:44.323006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8796b9-f173-4ed0-97f7-76b227706f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:44.323586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8796b9-f173-4ed0-97f7-76b227706f3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:44.324665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8796b9-f173-4ed0-97f7-76b227706f3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:44.326281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8796b9-f173-4ed0-97f7-76b227706f3b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:44.351185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 450/924] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:45.596054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790f89a-d998-4536-bda8-c9353cc944c0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:45.596645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790f89a-d998-4536-bda8-c9353cc944c0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:45.596645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790f89a-d998-4536-bda8-c9353cc944c0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:45.598327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 475/925] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:45.605055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:45.605560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:45.605646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:45.622823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:45.623990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:45.649561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62cab-a22a-4fb5-82c3-502ae8b42f4f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:45.649873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62cab-a22a-4fb5-82c3-502ae8b42f4f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:45.650132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62cab-a22a-4fb5-82c3-502ae8b42f4f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:45.651775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 476/926] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:45.656985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:45.657273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:45.657551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:45.660126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:45.676322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:45.678907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:45.708275 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 451/927] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:45.730141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:45.754367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 477/928] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:45.777266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:45.839301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297d60c-be58-478b-b4c6-c1aba024cdd7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:45.875471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:45.876231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:45.877905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:45.878491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:45.878960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:45.879075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c2b50-b1fb-4fe1-a26f-02185bdf7b09 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:45.879892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:45.881943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:45.895519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:45.896670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:45.897565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:45.905319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 452/929] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:45.906543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:45.915047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:45.915877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:45.916156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:45.916429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:45.927345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:45.935463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:45.936406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:45.937288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:45.941870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 478/930] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jul 21 05:27:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:45.943029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:45.945670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.018735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ceaa2-fb89-4ed5-845c-d952dd572908 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.046107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72fa80-0d35-454e-8790-9ca9486abbaa None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.055973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.056832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.057113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.057386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.058138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:46.058443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.060182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e6bd6-ff7e-4e90-8e11-ba70f6f696a1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.070094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 453/931] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:46.070094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5842766-0f0a-402d-b7b8-29e8383975be None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.070094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5842766-0f0a-402d-b7b8-29e8383975be None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.070094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5842766-0f0a-402d-b7b8-29e8383975be None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.070094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 454/932] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:46.073931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5842766-0f0a-402d-b7b8-29e8383975be None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.084582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.085256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.085573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.085845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.086589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:46.086892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.088267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d919c9-0bad-496e-801d-4faf340a58a5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.096538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 479/933] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:27:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:46.097773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.098033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.098307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.116384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:46.117868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:46.134818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.180989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.188262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5842766-0f0a-402d-b7b8-29e8383975be None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.199163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 480/934] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:46.199163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.223450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.224120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.224400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.225145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.225848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:46.226263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.227644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.232241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 455/935] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:46.232933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.342764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd63dc-3fc6-47db-891d-d14c12d2c44c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.360155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6573a04-f60b-4e31-afa9-2a5abf577ba8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.380760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.381589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.381870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.382143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.395508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.396552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.406113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.406889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.407174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.407489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.408154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.409807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b906dd7d-a824-4edd-bfb9-9f8f504cf8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:46.418501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:46.419443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:46.421920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:46.421920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:46.421920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:46.421920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:46.421920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 481/936] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:46.424844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671c9c-7e1b-4146-b375-5afdce6c3b54 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.424844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671c9c-7e1b-4146-b375-5afdce6c3b54 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.424844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671c9c-7e1b-4146-b375-5afdce6c3b54 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.430883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 482/937] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:46.431101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:46.432310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.433390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 456/938] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:46.434234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.434234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.434234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.434427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.437969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.450591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:46.451785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:46.461890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.525266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 483/939] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:46.526401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.541210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9a3f-e73f-49d9-b520-cee80ffadd60 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.575552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.576218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.576514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.576794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.577515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:46.577819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.579189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.590977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 457/940] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:46.591760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.643291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb2d3c-dee1-4cb4-8e1a-64e6fc0b5d8d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.674984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.681338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.682255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.682700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.683127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.683973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:46.684429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.685986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.687364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.691194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb2a4e-5fbe-4e0a-ae44-3a4073139843 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.696852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 484/941] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:46.697958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.728183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.728908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.729173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.729449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.730167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.731599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.733010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING keystone.server.flask.common [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 05:27:46.752259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.sql.core [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 05:27:46.752259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 05:27:46.752259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [parameters: {'id': '032306116a114426ab8774c8d1d9b03b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 05:27:46.752259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80393) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 032306116a114426ab8774c8d1d9b03b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 032306116a114426ab8774c8d1d9b03b. Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 05:27:46.760168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 05:27:46.761016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application yield resource Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise self.value Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application session.commit() Jul 21 05:27:46.762006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.flush() Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application compat.raise_( Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 05:27:46.762894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 05:27:46.763799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 05:27:46.764648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [parameters: {'id': '032306116a114426ab8774c8d1d9b03b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.765526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:46.769506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 032306116a114426ab8774c8d1d9b03b. Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 458/942] 10.222.0.18 () {60 vars in 1140 bytes} [Thu Jul 21 05:27:46 2022] POST /identity/v3/projects => generated 262 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:46.772713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.812162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424ecfb-9477-48a5-9419-31d8bbc14a90 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.850770 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.851738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.852100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.852442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.860253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.861738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.867059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d38dee-dc83-402f-a3ce-3cacdb0cf1b8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:46.876466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:46.877449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:46.878395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 485/943] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:46.879820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.907392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:46.908066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:46.908348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:46.908736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:46.909449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:46.909813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:46.911441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:46.919699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 459/944] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:46.920268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:46.927383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.946324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:46.994503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f09d8-7d74-4c7e-9de1-b16f8371e9cf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.029923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.030728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.031010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.031284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.032470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ce7da-7da4-44c8-9292-2d9a85cd27a5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.038806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.040666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:47.055689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:47.056643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:47.057530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 486/945] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:47.058041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.072175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.073184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.073485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.073982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.074726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:47.074998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.076580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.101248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 460/946] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jul 21 05:27:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:47.102404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.158415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41e51c-c7e2-4b31-93af-534fd0eaa436 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.165116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:47.177598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:47.197829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.198513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.198872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.199219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.200180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] RBAC: Adding query filter params (interface=public, service_id=eddcfc21fd5345cfa4976d825e727819, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:47.200605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.202034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.207522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 487/947] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/endpoints?service_id=eddcfc21fd5345cfa4976d825e727819&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:47.208308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.209410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e2ff-6342-4fb9-a002-6403a06235b8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.247111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.248036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.248614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.248893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.249653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:47.249963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.251519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.269834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 461/948] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:47.270628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.327357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f9ad-5ec6-4a67-aee2-90976afbade4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.383771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.384660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.384949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.385223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.399940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864aed3-6669-495d-918a-494aad896b01 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.401597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.404507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:47.425502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:47.426482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:47.427680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:47.427680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:47.427680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:47.427680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:47.427680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 488/949] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:47.435837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.439722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:47.455015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.455622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.455898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.456170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.456896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.458512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.468625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 462/950] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:27:47.477173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:47.555630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877220-23a1-4d74-b5c8-f65507ef822e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.592923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.593618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.593911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.594185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.594919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:47.595228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.596693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.610561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 489/951] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:47.616362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.724617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ceb2b-16fa-4e85-8467-f5bd8c94d63d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.759919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.760758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.761079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.761352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.768361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.769886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:47.783858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:47.784796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:47.785689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 463/952] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:47.793649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:47.898856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:47.905902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9cb3f-1c07-4d8f-9d37-48a394c30e66 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:47.942307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:47.943008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:47.943290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:47.943901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:47.944754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:47.945062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:47.946504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611590c-7760-4e28-91c3-c3c67b1bbb99 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:47.963017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 490/953] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:47.969043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:48.020078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:48.079879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73b47a-1f21-4261-b05b-6a8907c0e91d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:48.114258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcba47-dcc5-44e4-a829-abc5fdd3bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:48.115163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcba47-dcc5-44e4-a829-abc5fdd3bec5 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:48.115435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcba47-dcc5-44e4-a829-abc5fdd3bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:48.115702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcba47-dcc5-44e4-a829-abc5fdd3bec5 None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c0c4748fca7c432197e57f6a2d952fe0/roles/8f395d2379474151a4ad98613ebc69b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:48.118182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcba47-dcc5-44e4-a829-abc5fdd3bec5 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=c0c4748fca7c432197e57f6a2d952fe0, role_id=8f395d2379474151a4ad98613ebc69b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:48.119676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcba47-dcc5-44e4-a829-abc5fdd3bec5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:48.135750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 464/954] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:27:47 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/c0c4748fca7c432197e57f6a2d952fe0/roles/8f395d2379474151a4ad98613ebc69b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:27:48.298710 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b8e8-1798-46a6-8a76-808ea98023c1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:48.299330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b8e8-1798-46a6-8a76-808ea98023c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:48.299821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b8e8-1798-46a6-8a76-808ea98023c1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:48.301731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 491/955] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:48.307329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa5545-a6bc-46c2-9ecf-292c777df441 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:48.307924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa5545-a6bc-46c2-9ecf-292c777df441 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:48.308417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa5545-a6bc-46c2-9ecf-292c777df441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:48.329192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-06fa5545-a6bc-46c2-9ecf-292c777df441 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:48.331036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-06fa5545-a6bc-46c2-9ecf-292c777df441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:48.397437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 465/956] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:48.420151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8b8e8-1798-46a6-8a76-808ea98023c1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:48.532352 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8b8e8-1798-46a6-8a76-808ea98023c1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:48.570074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fc5a0-31f4-464e-a162-f6269778640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:48.570679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fc5a0-31f4-464e-a162-f6269778640a None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:48.570958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fc5a0-31f4-464e-a162-f6269778640a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:48.571240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fc5a0-31f4-464e-a162-f6269778640a None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:48.571976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fc5a0-31f4-464e-a162-f6269778640a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:48.573395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fc5a0-31f4-464e-a162-f6269778640a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:48.591587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 492/957] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:48 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:49.496322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346568b7-2670-439b-863e-0d35628d1e21 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:49.496895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346568b7-2670-439b-863e-0d35628d1e21 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:49.497161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346568b7-2670-439b-863e-0d35628d1e21 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:49.498946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 466/958] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:49.504217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfca29-adbb-46fd-933c-1d9049485885 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:49.504656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfca29-adbb-46fd-933c-1d9049485885 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:49.504986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfca29-adbb-46fd-933c-1d9049485885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:49.522793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-72cfca29-adbb-46fd-933c-1d9049485885 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:49.524010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-72cfca29-adbb-46fd-933c-1d9049485885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:49.533521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:49.601058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 493/959] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:49.603823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135125-a5dc-4289-95b5-a1640f9c5e9e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:49.604111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135125-a5dc-4289-95b5-a1640f9c5e9e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:49.604383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43135125-a5dc-4289-95b5-a1640f9c5e9e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:49.606964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 467/960] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:49.611251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:49.611541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:49.611872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:49.628445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:49.628639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135125-a5dc-4289-95b5-a1640f9c5e9e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:49.629635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:49.681959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:49.716601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 494/961] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:49.742162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:49.767748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43135125-a5dc-4289-95b5-a1640f9c5e9e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:49.801929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:49.802612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:49.802889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:49.803156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:49.803859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:49.805386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:49.816981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:49.820285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.sql.core [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 05:27:49.820285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 05:27:49.820285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [parameters: {'user_id': '7d35797fa4b04945abdce4d45fd25fdd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 05:27:49.820285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80393) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 21 05:27:49.829355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 05:27:49.830556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application yield resource Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise self.value Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application session.commit() Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 05:27:49.831791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.flush() Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application compat.raise_( Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 05:27:49.833381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 05:27:49.834781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 05:27:49.835979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [parameters: {'user_id': '7d35797fa4b04945abdce4d45fd25fdd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:49.837066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 05:27:49.838076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 468/962] 10.222.0.18 () {60 vars in 1131 bytes} [Thu Jul 21 05:27:49 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:49.848701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:49.859766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c83aa2-b042-4817-9b03-44c9aeda074d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:49.902344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:49.903973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:49.904396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:49.904830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:49.905782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:49.908015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:49.923654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:49.924804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:49.925670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:49.929054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 495/963] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:49.935571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:49.962278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:49.968358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e6756-1482-4668-a9cc-372ecac35582 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.016130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.017140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.017513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.018155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.028184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.030245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:50.048654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:50.049707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 05:27:50.050636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:50.053004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562234f4-0de8-4f9e-b01f-f6373a5d6586 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.055496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 469/964] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:27:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:50.056360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.090091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.091390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.091877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.092340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.093341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:50.094003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.095661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.097038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:50.108570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 496/965] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:50.110481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.174273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d408a28-e054-45af-bab5-ef7dd324f9d3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.210969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.211582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.212021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.212144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.213023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:50.213327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.214761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab330c2-7732-490e-8d4d-7a804fa48c97 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.233137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89678fed-e8ae-41be-a49a-b3d367cbe995 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.253550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 470/966] 10.222.0.18 () {56 vars in 1101 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:50.255034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f020-158b-4609-8c68-3d9936663082 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.255476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f020-158b-4609-8c68-3d9936663082 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.255649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f020-158b-4609-8c68-3d9936663082 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.261149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 471/967] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:50.263128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.263385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.263666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.282136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.283276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.283483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:50.283968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.284559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.285136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:50.285767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:50.286294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.289515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.296993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 497/968] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:50.302346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:50.303659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.371048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 472/969] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:50.397914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.399707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:50.449368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1b5d5-dbc1-47b0-8772-5dfb27175ae3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.498161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.498764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.499047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.499318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.500060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.501489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.527477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 498/970] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:27:50.538279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15d2ec-8ec6-47bc-b332-6cb8abb10063 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.587358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87906ad8-d0b1-40e6-8471-c58e7da09e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.588197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906ad8-d0b1-40e6-8471-c58e7da09e22 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.588501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906ad8-d0b1-40e6-8471-c58e7da09e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.588768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87906ad8-d0b1-40e6-8471-c58e7da09e22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.600798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87906ad8-d0b1-40e6-8471-c58e7da09e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-87906ad8-d0b1-40e6-8471-c58e7da09e22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:50.609167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:50.610196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:50.611053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 473/971] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:50.617044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.684103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4abac-028f-4d6b-ba7b-68627f0bbd5f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.684423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4abac-028f-4d6b-ba7b-68627f0bbd5f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.684737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4abac-028f-4d6b-ba7b-68627f0bbd5f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.686094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 474/972] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:50.690994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.691280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.691556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.697467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:50.710600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:50.711798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:50.727408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1886b3c-f24e-4380-8eda-ba43b644a946 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.745516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:50.765436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.766045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.766339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.766716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.767469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:50.767778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.769295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.778404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 499/973] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:50.784501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.784638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 475/974] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:50.803570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.887673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921a96-3b16-4a0b-85f3-be2b9842606e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.906417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a915b-e011-4b87-b00c-337afd0334b1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:50.924327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.925154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.925429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.925699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.936442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.937211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:50.937953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.944153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:50.945653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:50.946133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:50.946580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:50.947740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:50.949284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:50.955906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:50.956961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:50.958044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:50.958044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:50.958044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:50.958044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:50.961824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 500/975] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:50.962697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:50.964422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:50.965590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:50.966625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:50.973652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 476/976] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:50.974635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:50.995902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.066538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b9eea-e377-48c1-b9a4-8a7c2d0e9ddf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.087753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fc8a1-725f-4bd2-ad1e-a81fa8154265 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.100231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.100992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.101250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.101523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.102274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:51.102548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.103934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.116181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 501/977] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:51.121984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.130004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.130667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.130959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.131230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.131939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:51.132415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.133768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.138852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 477/978] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:51.144281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.208251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.224896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.234462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9f771-6965-4933-a533-5c3dfbf247d7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.254493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58ce6f-e7d7-4bf1-afdf-23dac75a54d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.270482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.271385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.271735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.272271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.280423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.281997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.289577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.290253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.290533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.290804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.291516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:51.291823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.293215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.298393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 478/979] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:51.298520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:51.304695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 502/980] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:51.305651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.306325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.415228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34474-76be-436e-a473-a9af8964ac1e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.419862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d19ee-1497-481e-94e6-718809cb3142 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.440127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.451883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.452604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.452901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.453157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.453993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:51.454301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.455733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.459867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.460841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.461327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.461814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.462799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] RBAC: Adding query filter params (interface=public, service_id=5d5071b73a544441be86a8ce94796d3b, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:51.463332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.465192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.472458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 503/981] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/endpoints?service_id=5d5071b73a544441be86a8ce94796d3b&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:51.473316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 479/982] 10.222.0.18 () {56 vars in 1149 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:51.482744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.482870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.501441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.589458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27876-ab1f-4b27-b72b-c5d790077b3f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.592635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271e9b0-e282-45ff-9c7d-c2557c44d7f7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.624245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.624936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.625216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.625489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.632703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.633381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.634088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.634376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.635063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.636843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.643851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 504/983] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:27:51.686598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.709438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.711041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.821117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 480/984] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:27:51.826749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:51.910704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:51.931652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5be09-cd52-4477-995d-b2b1af685281 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:51.968222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:51.969020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:51.969300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:51.969624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:51.980297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:51.981790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:51.999608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:52.000555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:52.001528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:52.001528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:52.001528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:52.001528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:52.001528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 505/985] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:27:52.006471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:52.091017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:52.111522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9bd82-d1a6-4a35-aa57-a00748e5c8fe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:52.147399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:52.148111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.148394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.148702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.149427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:52.149735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:52.151123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:52.163084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 481/986] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:52.168859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:52.270999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd110e-6763-4f01-81ee-2ccb1d162d18 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:52.302605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:52.308835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:52.309940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.310443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.310951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.318561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:52.320272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:52.334150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:52.335110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:52.336137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:52.342800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 506/987] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:52.343863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:52.459509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67229eb-5a3b-4cfd-8f7e-381ea28a4fb2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:52.494955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:52.495625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.495907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.496186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.497000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:52.497310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:52.498754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eed8c7-36dc-4877-a248-b7e49cd6e3dc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:52.511242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 482/988] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:52.517396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:52.594524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca25da-1343-4ef4-8b06-df13d9bc258d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.595095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca25da-1343-4ef4-8b06-df13d9bc258d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.595095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca25da-1343-4ef4-8b06-df13d9bc258d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.596406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 483/989] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:52.601531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.601784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.602061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.607181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:52.620735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:52.621934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:52.625067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635624d-c3bd-46bf-ba33-ba95e5655a83 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:52.660080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:52.660757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.661041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.661316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.662140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] RBAC: Adding query filter params (role.id=8f395d2379474151a4ad98613ebc69b7, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=c0c4748fca7c432197e57f6a2d952fe0) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:52.662451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:52.663985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:52.669977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 507/990] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:52 2022] GET /identity/v3/role_assignments?user.id=c0c4748fca7c432197e57f6a2d952fe0&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=8f395d2379474151a4ad98613ebc69b7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:52.705046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 484/991] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:52.728298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:52.797906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:52.849425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fac869-9d7a-4b10-bf3b-8e8e2fb7b981 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:52.884243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:52.885473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:52.885958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:52.886415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:52.887273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:52.888685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:52.900637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:52.901661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:52.903180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 508/992] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:52.907880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:53.010271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee2bac-0f11-4987-a956-1a85e2a938ab None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:53.039784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:53.046260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:53.046947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.047226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.047495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.048206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:53.048528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:53.049980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:53.055708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 485/993] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:53.061393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:53.165886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad7036-4edf-4ebd-bee0-07a13283d14a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:53.188172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:53.204074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:53.204789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.205066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.205337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.206032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:53.206333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:53.207705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:53.217529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 509/994] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:53.218892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:53.321354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74929c-9750-40af-b6dd-f6ac42da66b7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:53.355598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:53.356267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.356571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.356843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.357647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] RBAC: Adding query filter params (interface=admin, service_id=eddcfc21fd5345cfa4976d825e727819, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:53.357960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:53.359333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f69dde-552e-4940-b0f8-d1bd541f8935 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:53.364802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 486/995] 10.222.0.18 () {56 vars in 1249 bytes} [Thu Jul 21 05:27:53 2022] GET /identity/v3/endpoints?service_id=eddcfc21fd5345cfa4976d825e727819&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:53.370344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:53.480070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba0fcd-8279-4f58-b767-702c7f8dfcc4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:53.512596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950e74-4e23-46a6-a303-087d05d1f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:53.513262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950e74-4e23-46a6-a303-087d05d1f034 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.513563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950e74-4e23-46a6-a303-087d05d1f034 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.513816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950e74-4e23-46a6-a303-087d05d1f034 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.514488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf950e74-4e23-46a6-a303-087d05d1f034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:53.515863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf950e74-4e23-46a6-a303-087d05d1f034 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:53.522252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 510/996] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:27:53 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:27:53.693980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908166-210b-4383-9346-5f67be1b0c1b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.694483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908166-210b-4383-9346-5f67be1b0c1b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.694483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e908166-210b-4383-9346-5f67be1b0c1b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.696185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 487/997] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:53.701442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.701884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.701979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.719169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:53.720353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:53.765999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:53.790648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 511/998] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:53.813508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908166-210b-4383-9346-5f67be1b0c1b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:53.876167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:53.919395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e908166-210b-4383-9346-5f67be1b0c1b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:53.953608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:53.954336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:53.954615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:53.954884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:53.955531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:53.956933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:53.968671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:53.969859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 05:27:53.970702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:53.971585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 488/999] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:53.975921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:54.075963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d737d5-8349-48cd-b0ed-b3ce965b874f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:54.109331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:54.110001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:54.110283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:54.110559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:54.111261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:54.111566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:54.112983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:54.118064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 512/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:54.123691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:54.227824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8b86-e6d3-4e4d-b4ea-921d26460b9e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:54.251078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:54.263689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:54.264366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:54.264678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:54.264949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:54.265650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:54.265958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:54.267336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc7f69-c3d2-46d8-9ab4-4ce5aecb659e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:54.272499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 489/1001] 10.222.0.18 () {56 vars in 1112 bytes} [Thu Jul 21 05:27:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:54.278250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:54.323414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:54.380884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f1aa2-0656-47d7-9606-9a4c33d75be8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:54.424912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e734d-cd63-41c6-b3d7-70b29de5c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:54.425548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e734d-cd63-41c6-b3d7-70b29de5c1ad None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:54.425832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e734d-cd63-41c6-b3d7-70b29de5c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:54.426107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e734d-cd63-41c6-b3d7-70b29de5c1ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:54.426886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e734d-cd63-41c6-b3d7-70b29de5c1ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:54.428272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e734d-cd63-41c6-b3d7-70b29de5c1ad None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:54.448724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 513/1002] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:27:54.746455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81a449-9316-4580-9082-09e25a6d2789 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:54.747005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81a449-9316-4580-9082-09e25a6d2789 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:54.747005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81a449-9316-4580-9082-09e25a6d2789 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:54.748556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 490/1003] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:54.753755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0166-da07-443d-88b6-f33af560707c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:54.754189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0166-da07-443d-88b6-f33af560707c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:54.754269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf0166-da07-443d-88b6-f33af560707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:54.771195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fadf0166-da07-443d-88b6-f33af560707c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:54.772379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fadf0166-da07-443d-88b6-f33af560707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:54.848121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 514/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:54 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:54.870005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81a449-9316-4580-9082-09e25a6d2789 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:54.973773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81a449-9316-4580-9082-09e25a6d2789 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:55.010091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:55.010813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.011091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.011359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] PATH_INFO: `/v3/services/image` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.012015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:55.013425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:55.025099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:55.026169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:55.027024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 491/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jul 21 05:27:54 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:55.032420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0166-da07-443d-88b6-f33af560707c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:55.058371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:55.137185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf0166-da07-443d-88b6-f33af560707c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:55.172118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:55.172881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.173166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.173424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.174152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] RBAC: Adding query filter params (name=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:55.174412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:55.175812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c971-d144-4bb5-93cf-885155798aad None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:55.185781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 515/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:55.187082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:55.242620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:55.294583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88e42c-551f-4422-b134-4cb50017fa5c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:55.330761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:55.331433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.331711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.332022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.332768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:55.333142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:55.334526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351744d-90c1-4ef6-bd79-f47853edefc2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:55.344515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 492/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:55.551291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff48d1-8110-47ec-aeea-ec5e4ae5f3b4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.551630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff48d1-8110-47ec-aeea-ec5e4ae5f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.551805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff48d1-8110-47ec-aeea-ec5e4ae5f3b4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.553251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 516/1008] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:55.558731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.558997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.559290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.576755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:55.577918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:55.648669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 493/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:55 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:55.671844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff48d1-8110-47ec-aeea-ec5e4ae5f3b4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:55.763450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:55.779965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff48d1-8110-47ec-aeea-ec5e4ae5f3b4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:55.827716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:55.828911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.829362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.829667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.830312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:55.831737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:55.847596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:55.848953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 05:27:55.849839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:55.852840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 517/1010] 10.222.0.18 () {56 vars in 1126 bytes} [Thu Jul 21 05:27:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:55.856519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:55.905052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:55.959989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f3240-664f-48f7-99d9-5483409b4f51 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:55.993801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:55.994471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:55.994746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:55.995013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:55.995707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:55.996011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:55.997399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:56.002477 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 494/1011] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:56.008395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:56.113196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d101e4b-0368-4096-b009-b25d9d6ef9a1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:56.148279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:56.148981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:56.149265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:56.149533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:56.150273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:56.150578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:56.151969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e090e5-a2cf-4a02-b76a-1c10d4d18235 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:56.157684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 518/1012] 10.222.0.18 () {56 vars in 1122 bytes} [Thu Jul 21 05:27:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:56.163242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:56.268498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d0b7b-fbd3-4ff6-8560-7581f89e8fde None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:56.279714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:56.307168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba0c2-7345-4e6f-8f92-481b9da9ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:56.307837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba0c2-7345-4e6f-8f92-481b9da9ae8f None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:56.308117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba0c2-7345-4e6f-8f92-481b9da9ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:56.308405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba0c2-7345-4e6f-8f92-481b9da9ae8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:56.309189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba0c2-7345-4e6f-8f92-481b9da9ae8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:56.310653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ba0c2-7345-4e6f-8f92-481b9da9ae8f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:56.327224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 495/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:27:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:27:56.582431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e8e7-8165-4f54-b0b7-060665b85c00 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:56.582800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e8e7-8165-4f54-b0b7-060665b85c00 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:56.582973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e8e7-8165-4f54-b0b7-060665b85c00 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:56.584499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 519/1014] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:56.590048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:56.590403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:56.590753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:56.607922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:56.609147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:56.685405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 496/1015] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:56.709031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e8e7-8165-4f54-b0b7-060665b85c00 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:56.728935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:56.815278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e8e7-8165-4f54-b0b7-060665b85c00 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:56.850908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:56.851735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:56.852017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:56.852292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:56.862656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:27:56.870748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:56.871687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:27:56.872582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:56.876943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 520/1016] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jul 21 05:27:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:56.878051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:56.971353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:56.979037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c205b0-c516-47de-9ab5-4bb607951155 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.014538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.015214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.015491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.015758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.016524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:57.016850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.018228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:57.026916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 497/1017] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:27:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:57.032522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:57.112070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:57.139549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5841-3fb9-49db-9190-3739b5b7a694 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.173502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.174410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.174684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.174934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.185873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.187320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fe22f96f-2713-4a7d-83ea-27377b7f5864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:57.204850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:57.205765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:57.211989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:57.211989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:57.211989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:57.211989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:57.211989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 521/1018] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:57.212270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:57.321276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f424f-2ea8-4b50-8e2c-fe9eb0fda72f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.354940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.355599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.355880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.356150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.357620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:57.357927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.359290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:57.367758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fcb05-8b96-45b4-bd29-0a045841e977 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.368032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fcb05-8b96-45b4-bd29-0a045841e977 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.368307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fcb05-8b96-45b4-bd29-0a045841e977 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.369972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 522/1019] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:57.376245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 498/1020] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:57.376385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.376385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.376385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.377992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:57.393381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:57.394585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:57.398213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:57.475609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 523/1021] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:57 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:57.493749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc901f6-6031-48b9-8ff2-bdeb9dbfb7c6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.498244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:57.531182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.531994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.532334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.532655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.540045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.541535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:27:57.556209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:57.557458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:57.558421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 499/1022] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:27:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:57.560759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:57.563347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:57.607771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c06f52-abd5-4d87-9278-71f9442a6bb2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.641595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.642267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.642552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.642907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.643644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.645067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:57.647316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:57.659719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 524/1023] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:57 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:27:57.671827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f40d-1b5d-4974-8bd3-1d6443c9a5b9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.717888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.718583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.718862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.719172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.720031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:57.720338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.721847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:57.747358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 500/1024] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:27:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:57.748982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:57.854931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7beedf-6007-47ec-83d9-c15b107302f1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:57.876105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:57.892855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:57.893527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:57.893803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:57.894078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:57.965864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:57.967363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.071973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 525/1025] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:27:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 05:27:58.073341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.174064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6e75c-c31c-4a00-a0ff-9b0c56956a81 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.204383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:58.211233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.212066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.212354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.212674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.224008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.225558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-aa5bfff4-1779-435f-8f26-4947c215e11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:27:58.244858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:58.245850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:58.251511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:27:58.251511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:27:58.251511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:27:58.251511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:58.251511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 501/1026] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:58.253043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.272795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:58.355718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c50e02-0147-48f1-a7db-c29b0276bb09 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.390166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.391128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.391557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.391989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.392889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:58.393358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.394920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.401331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93701bb7-8f94-4bd0-9f70-b302fc78c66f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.401616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93701bb7-8f94-4bd0-9f70-b302fc78c66f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.401891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93701bb7-8f94-4bd0-9f70-b302fc78c66f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.403258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 502/1027] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:27:58.408483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.408794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.409066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.413264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 526/1028] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:58.418782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.434018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:58.435193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:58.503543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:58.516762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 503/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:27:58.527068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bcccc-c6de-4e3e-8751-e1291e2c2334 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.528017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.564072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.564919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.565194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.565471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.573866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.575747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:27:58.590510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:58.591405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:27:58.592451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 527/1030] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:27:58.597459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.632648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0cff4-9ee6-4cff-84b8-d66d6e441714 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.646401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:58.666104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.666908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.667182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.667464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.668657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.670062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.671687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 504/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:58.677533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.717261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3e1a-85f4-4c2e-8388-d1f35896e2dc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.753156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.753832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.754112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.754386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.755181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:58.755600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.757161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.764360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:58.773789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 528/1032] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:27:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:27:58.779800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:58.789659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d8750-8c95-4a8e-89e1-2fe08b710c92 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.827439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c1d5b-bb4a-4335-b12a-0c589815e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.828109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1d5b-bb4a-4335-b12a-0c589815e080 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.828383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1d5b-bb4a-4335-b12a-0c589815e080 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.828686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c1d5b-bb4a-4335-b12a-0c589815e080 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.829405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c1d5b-bb4a-4335-b12a-0c589815e080 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.830860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c1d5b-bb4a-4335-b12a-0c589815e080 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.868510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 505/1033] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:27:58 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:27:58.894132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483241b7-2db3-4e71-807d-a6ee06f86ff0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:58.932014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:58.932636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:58.932919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:58.933192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:58.934040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] RBAC: Adding query filter params (role.id=8f395d2379474151a4ad98613ebc69b7, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=89e2cefbcf0449ff8fb8b695bba26dd3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:27:58.934357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:58.935835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebede983-bfb7-4da0-9c7c-b3e14d40af39 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:58.948518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 529/1034] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:27:58 2022] GET /identity/v3/role_assignments?user.id=89e2cefbcf0449ff8fb8b695bba26dd3&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=8f395d2379474151a4ad98613ebc69b7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:27:59.722870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfdf9-2699-4b85-92dc-bb611e947260 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:59.723374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfdf9-2699-4b85-92dc-bb611e947260 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:59.723374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfdf9-2699-4b85-92dc-bb611e947260 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:59.725106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 506/1035] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:27:59.730470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:59.730741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:59.731041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:59.747934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:27:59.749148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:27:59.803531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:59.815091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 530/1036] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:27:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:27:59.838136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acfdf9-2699-4b85-92dc-bb611e947260 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:27:59.876490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:27:59.946184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acfdf9-2699-4b85-92dc-bb611e947260 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:27:59.981209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:27:59.981935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:27:59.982213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:27:59.982486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] PATH_INFO: `/v3/services/image` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:27:59.983147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:27:59.984593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:27:59.997206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:27:59.998325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:27:59.999183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 507/1037] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jul 21 05:27:59 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:00.006913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:00.108971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f67d3-6394-4b7b-b933-622227e8e7d3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:00.143691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:00.144357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.144697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.144976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.145683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] RBAC: Adding query filter params (name=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:00.145997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:00.147379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:00.152690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 531/1038] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:00.158381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:00.261351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:00.265431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832e81e-f2ff-4c72-8df1-5d31e2659b10 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:00.300415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:00.301106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.301469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.301740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.302490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] RBAC: Adding query filter params (type=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:00.302799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:00.304207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:00.314284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 508/1039] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:00.315548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:00.374325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:00.426389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b37b9-3583-47c2-8dee-d8e5d6a84b5f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:00.460978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:00.461646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.461930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.462205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.463000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] RBAC: Adding query filter params (interface=public, service_id=35aa372af00d4cbf937e1317fab8b077, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:00.463312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:00.464718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0ebd9-59f7-43ca-b949-03328984f98a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:00.470021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 532/1040] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:28:00 2022] GET /identity/v3/endpoints?service_id=35aa372af00d4cbf937e1317fab8b077&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:00.475684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:00.577568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9ef4a-64ef-4172-98b2-c10c4d21014b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:00.611190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2dadf-c8ca-47e6-a0df-b0da0863b4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:00.611867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2dadf-c8ca-47e6-a0df-b0da0863b4dc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.612143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2dadf-c8ca-47e6-a0df-b0da0863b4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.612418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2dadf-c8ca-47e6-a0df-b0da0863b4dc None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.615012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2dadf-c8ca-47e6-a0df-b0da0863b4dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:00.615012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2dadf-c8ca-47e6-a0df-b0da0863b4dc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:00.628513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 509/1041] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:28:00 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:28:00.917475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7057c1-4b92-4977-b7c8-b164628682e5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.917662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7057c1-4b92-4977-b7c8-b164628682e5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.917914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7057c1-4b92-4977-b7c8-b164628682e5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.919490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 533/1042] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:00.924735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.925214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.925291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.942457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:00.943995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:00.962188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7f77-5b70-4efd-93f2-7c0bc978b82b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.962483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7f77-5b70-4efd-93f2-7c0bc978b82b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.962737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7f77-5b70-4efd-93f2-7c0bc978b82b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.964242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 534/1043] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:28:00.964816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:00.969683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:00.969954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:00.970228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:00.989212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:00.990421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:01.017875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 510/1044] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:01.043408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.062301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 535/1045] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:28:01.085207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.135999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:01.147918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281281a-6084-4c7d-901d-c45a69b24cb3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.184938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.185668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.185949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.186219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.186332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df122-a31b-4f1c-b535-e64dff163697 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.187388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:01.188935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:01.190746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 511/1046] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:01.196665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.222588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:01.226171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.226998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.227284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.227597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.238310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:01.246376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:01.247329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:01.248231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 536/1047] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:01.254207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.310019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f932ff-0e4a-4acf-b941-454ef935bc4a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.348028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.348768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.349052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.349330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.350064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:01.351553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:01.371849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d218-9a49-474f-9746-846cc1e87307 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.374369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 512/1048] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:28:01 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:28:01.384350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:01.418696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.419361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.419650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.419926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.421288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:01.421288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:01.423846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:01.433379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 537/1049] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:01.439189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.530772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:01.552256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be473e-aadc-4384-89b1-66ddea98782d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.590408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.591228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.591499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.591763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.603063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:01.604556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:28:01.622734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:01.623692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:01.624636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:28:01.624636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:28:01.624636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:01.624636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:01.624636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 513/1050] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:01.630613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.735702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87f2c5-a521-4f37-b4ec-1926a3344144 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.771163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.771838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.772121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.772428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.773179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:01.773484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:01.774876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:01.787878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 538/1051] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:01.793543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:01.897683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a275abf-e4da-48c5-a60c-520efb360173 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:01.927865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:01.934781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:01.935580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:01.935865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:01.936148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:01.944694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:01.946151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:28:01.960036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:01.961241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:28:01.962529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:01.963406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 514/1052] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:01.967171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.000014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:02.071911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c419f55-fb5c-4f23-86f5-52a7504408e3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.107463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.108141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.108566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.108732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.109585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:02.109878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.111324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.129194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 539/1053] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:28:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:02.134946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.239181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61a8d-27ce-433a-b7db-8f6a9d4170ca None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.273770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.274503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.274778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.275049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.285718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.287165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:28:02.304104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:02.305007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:02.305906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:28:02.305906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:28:02.305906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:02.305906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:02.308722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 515/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:02.311187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.409079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:02.422539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633580c-230a-4e01-94fa-ec8ee857d9fc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.458896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.459572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.459877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.460157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.460905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:02.461214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.462601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb06e6-c386-406b-91dc-277531932dbc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.474184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 540/1055] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:02.479779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.527206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:02.587700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc538-3fe3-4f21-b633-d96b70856cc3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.623720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.624510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.624809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.625083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.632551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.634000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.639598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc1a6-f9d8-4408-be03-db0fa9988751 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.639893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc1a6-f9d8-4408-be03-db0fa9988751 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.640196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc1a6-f9d8-4408-be03-db0fa9988751 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.641736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 541/1056] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:28:02.646331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.646621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.646868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:28:02.648456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:02.649367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:02.650468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 516/1057] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:02.655195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.665458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:02.666630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:02.737038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 542/1058] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:28:02.759987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.764122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e371-b038-4930-8d8e-362a00e7ca3a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.767164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:02.805203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.806227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.806764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.807048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.808004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:02.808319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.810056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.824256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 517/1059] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:02.830305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.839897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:02.860841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe772ac-5c68-4ae5-a20b-3d53ab49eef3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.896825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.897731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.898010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.898281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] PATH_INFO: `/v3/services/image` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.898937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.900318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:02.912113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:02.913368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:02.914465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 543/1060] 10.222.0.18 () {56 vars in 1105 bytes} [Thu Jul 21 05:28:02 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:02.919689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:02.937823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e231bb-b839-4508-867c-f306fed5451e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:02.973542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:02.974569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:02.974856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:02.975129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/89e2cefbcf0449ff8fb8b695bba26dd3/roles/8f395d2379474151a4ad98613ebc69b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:02.977427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=89e2cefbcf0449ff8fb8b695bba26dd3, role_id=8f395d2379474151a4ad98613ebc69b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:02.978866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:02.993601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 518/1061] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:28:02 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/89e2cefbcf0449ff8fb8b695bba26dd3/roles/8f395d2379474151a4ad98613ebc69b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:28:03.027547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d001-c276-4d23-89b3-ab5aa8ced01e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:03.065487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:03.066089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.066384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.066643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.067362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] RBAC: Adding query filter params (name=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:03.067678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:03.069527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:03.075287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 544/1062] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:03.081099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:03.112036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:03.198163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0a0f-9b9f-4902-8ef7-9aacca1788cc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:03.231858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:03.232558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.232841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.233110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.233819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] RBAC: Adding query filter params (type=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:03.234127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:03.235498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff519c7-a2a8-46d3-a745-1c2763213849 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:03.244548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 519/1063] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:03.246679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:03.257867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:03.348176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40c332-5dde-4d1d-9bea-0fd20fe7f625 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:03.383081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c0a51-dd3f-4d05-b884-e4ea974e2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:03.383755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0a51-dd3f-4d05-b884-e4ea974e2b00 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.384034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0a51-dd3f-4d05-b884-e4ea974e2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.384306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c0a51-dd3f-4d05-b884-e4ea974e2b00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.385081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c0a51-dd3f-4d05-b884-e4ea974e2b00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:03.386458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c0a51-dd3f-4d05-b884-e4ea974e2b00 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:03.412523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 545/1064] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:28:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:28:03.469663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225fce6-f6ce-42a8-a5c9-4d32de9cdfff None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.470008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225fce6-f6ce-42a8-a5c9-4d32de9cdfff None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.470178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225fce6-f6ce-42a8-a5c9-4d32de9cdfff None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.471847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 520/1065] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:03.477641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.477939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.478200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.496234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:03.497490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:03.563969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:03.583931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 546/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:03.607282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225fce6-f6ce-42a8-a5c9-4d32de9cdfff None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:03.700124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:03.714220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225fce6-f6ce-42a8-a5c9-4d32de9cdfff None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:03.748049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:03.748921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.749184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.749458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.760323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:03.767902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:03.769024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:03.770116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 521/1067] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:03.775530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:03.876903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b4d0a-3cf7-4aa9-bb18-3c7b7a9a6e2b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:03.912350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:03.913111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:03.913392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:03.913667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:03.914405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:03.914708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:03.916091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:03.924511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 547/1068] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:03.930348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:04.034251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f00a1-7196-4172-ad51-ef53e1bd7062 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:04.069417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:04.070304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:04.070585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:04.070858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] PATH_INFO: `/v3/users/8d011e2b63674939a58f2e5fb1e47e9b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:04.084658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] RBAC: Authorizing `identity:get_user(user_id=8d011e2b63674939a58f2e5fb1e47e9b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:04.086151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:04.088069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 522/1069] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:03 2022] GET /identity/v3/users/8d011e2b63674939a58f2e5fb1e47e9b => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:04.093713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:04.151400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:04.201846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96743bbf-c0c6-4225-9397-8e4157139603 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:04.236204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:04.236907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:04.237186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:04.237462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:04.306036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:04.307489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:04.360284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:04.415566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 548/1070] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:04.423149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:04.435017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:04.531645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fadf33-4c0b-4f3f-a869-f25d20564bfa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:04.569936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22477cef-3374-4a49-9caa-213f51d11926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:04.570809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22477cef-3374-4a49-9caa-213f51d11926 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:04.571090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22477cef-3374-4a49-9caa-213f51d11926 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:04.571358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22477cef-3374-4a49-9caa-213f51d11926 None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:04.572674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22477cef-3374-4a49-9caa-213f51d11926 None admin] RBAC: Authorizing `identity:get_project(project_id=806d7f44013d461582c2f0bde1480beb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:04.574061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22477cef-3374-4a49-9caa-213f51d11926 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:04.575964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 523/1071] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:04 2022] GET /identity/v3/projects/806d7f44013d461582c2f0bde1480beb => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:04.581983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:04.684459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38f0ee-bd2c-40db-8700-33160e202571 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:04.719669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:04.720331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:04.720642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:04.720891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:04.721745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=806d7f44013d461582c2f0bde1480beb, user.id=8d011e2b63674939a58f2e5fb1e47e9b) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:04.722055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:04.723489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a59a8-2262-42d8-afe5-8dbda7fac21b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:04.729413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 549/1072] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:04 2022] GET /identity/v3/role_assignments?user.id=8d011e2b63674939a58f2e5fb1e47e9b&scope.project.id=806d7f44013d461582c2f0bde1480beb&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:05.020404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32579d-10f3-4156-b917-2c93ab74e8a8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.020618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32579d-10f3-4156-b917-2c93ab74e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.020866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32579d-10f3-4156-b917-2c93ab74e8a8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.022347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 524/1073] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:05.027762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.028013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.028318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.045112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:05.046292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:05.057520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.115879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 550/1074] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:05.138704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32579d-10f3-4156-b917-2c93ab74e8a8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.217639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.244493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32579d-10f3-4156-b917-2c93ab74e8a8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:05.278020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702e3f6-caed-4efa-b574-6268b13952dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:05.278761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702e3f6-caed-4efa-b574-6268b13952dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.279032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702e3f6-caed-4efa-b574-6268b13952dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.279299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702e3f6-caed-4efa-b574-6268b13952dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.289525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702e3f6-caed-4efa-b574-6268b13952dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7702e3f6-caed-4efa-b574-6268b13952dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:05.297560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:05.298489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 05:28:05.299350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:05.303799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 525/1075] 10.222.0.18 () {56 vars in 1120 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:05.304858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.407899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c0f29-7747-4ab1-a829-b6cc38e39c1b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:05.447787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:05.448456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.448766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.449033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.449368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172daaa-d656-4db8-bcd9-6cf51627a9b4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.449655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172daaa-d656-4db8-bcd9-6cf51627a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.449771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:05.449923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172daaa-d656-4db8-bcd9-6cf51627a9b4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.450075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:05.451450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 526/1076] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:28:05.451550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:05.456074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.456356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.456661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.460267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 551/1077] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:05.465549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.474337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:05.475578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:05.476846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.543769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 527/1078] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:28:05.566476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.571063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238253e-ea0b-440b-ab3c-3953f0e02374 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:05.605408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:05.606199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.606487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.606721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.618917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:05.620365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:05.630650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:28:05.640835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:05.641734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:05.642853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:28:05.642853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:28:05.642853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:05.642853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:05.642853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 552/1079] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:05.647646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.673799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f52f3-9d67-4a25-a73b-ef5c9768b95f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:05.708442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.711095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:05.712000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.712351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.712721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.760147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937fe75-5827-4da5-a00f-42d7c6f54bb3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:05.786177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:05.787824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:05.793645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:05.794604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.795038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.795459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.796347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:05.796866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:05.798462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:05.811963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 553/1080] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:05.817155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.859498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.900826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 528/1081] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:05.907399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:05.923719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5061d7-a69f-4e08-9bbc-b97615b33e1f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:05.945172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:05.961466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:05.962267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:05.962539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:05.962804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:05.970812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:05.972402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:28:05.987300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:05.988444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 05:28:05.989452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:05.990335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 554/1082] 10.222.0.18 () {56 vars in 1093 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:05.996098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.015227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd8ec-e722-428c-883d-d0fa02bf9216 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.052537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.053357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.053666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.053979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.064828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:06.066400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:28:06.085171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:06.086106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:06.087001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:28:06.087001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:28:06.087001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:06.087001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:06.091373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 529/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:06.092683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.112311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:06.127811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4224f-4e21-4db8-bdaf-6fb16af41f2c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.165599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.166281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.166566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.166835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.167672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:06.167981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:06.169459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:06.187369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 555/1084] 10.222.0.18 () {56 vars in 1133 bytes} [Thu Jul 21 05:28:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:06.193368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.199659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1b77b-8d72-4596-abea-03c0089601f8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.234815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.235488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.235775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.236051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.236805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:06.237115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:06.238325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:06.238531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:06.260505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 530/1085] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:06.313547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23768c-151a-4e31-bd40-32b61309a673 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.352107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf23c-eef5-49cc-ac54-81ad0295e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.352850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf23c-eef5-49cc-ac54-81ad0295e5ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.353130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf23c-eef5-49cc-ac54-81ad0295e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.353404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf23c-eef5-49cc-ac54-81ad0295e5ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.441755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf23c-eef5-49cc-ac54-81ad0295e5ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:06.443571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bf23c-eef5-49cc-ac54-81ad0295e5ed None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:06.484333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:06.547916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 556/1086] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 05:28:06.554058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.631372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:06.655481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb506-50a0-4944-9a36-004ed0568f1e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.689104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.689903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.690184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.690451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.701736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:06.703186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:28:06.720290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:06.721252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:06.722370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:28:06.722370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:28:06.722370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:28:06.722370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:06.722370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 531/1087] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:06.726623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584f5e5-c911-45e3-b651-afe8533399c2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.726981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584f5e5-c911-45e3-b651-afe8533399c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.727112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.727409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584f5e5-c911-45e3-b651-afe8533399c2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.728613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 557/1088] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:06.733748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.734032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.734305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.751561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:06.752835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:06.819350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 558/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:06.826955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad08422-dafc-462e-b0d0-feee3e7b9870 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.841960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.855833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:06.864188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.864888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.865167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.865429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.866226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:06.866538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:06.867906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:06.879547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 532/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:06.885522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:06.908909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:06.941756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b078b7-79e6-4542-9eae-7abdcc4d91ea None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.975074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:06.975917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:06.976215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:06.976496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:06.982498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c730d-4898-4fc2-af0f-5f0616a254da None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:06.986571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:06.994056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:06.995048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:06.995889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 559/1091] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:07.001166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:07.017644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.018445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.018722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.018989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.025866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.027303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:28:07.040879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:07.041955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:07.043023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 533/1092] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:28:07.047851 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:07.097455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:07.098765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53e212-b6d2-4b4e-b12d-88009c5457d8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:07.124360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:07.132933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.133620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.133901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.134181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.134914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:07.135215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.136694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.145189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 560/1093] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:07.148310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb91d7-fb25-4436-8631-838d6d1de1a6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:07.151097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:07.182474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.183132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.183409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.183675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.184468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:07.184801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.186227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.198661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 534/1094] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:07.204834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:07.247106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9194b-0c24-4f92-a14b-a196d83155f6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:07.279207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.280082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.280365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.280670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] PATH_INFO: `/v3/users/8d011e2b63674939a58f2e5fb1e47e9b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.281862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] RBAC: Authorizing `identity:get_user(user_id=8d011e2b63674939a58f2e5fb1e47e9b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.283348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.284963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 561/1095] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:07 2022] GET /identity/v3/users/8d011e2b63674939a58f2e5fb1e47e9b => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:07.291262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:07.302110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef40e5-59ef-48eb-978f-5be9669c972b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:07.312183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:07.338006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.338660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.338943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.339201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.340022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] RBAC: Adding query filter params (role.id=8f395d2379474151a4ad98613ebc69b7, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=89e2cefbcf0449ff8fb8b695bba26dd3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:07.340329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.341774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.347466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 535/1096] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:07 2022] GET /identity/v3/role_assignments?user.id=89e2cefbcf0449ff8fb8b695bba26dd3&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=8f395d2379474151a4ad98613ebc69b7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:07.348014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:07.394083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b3a2-73e4-4c70-a1eb-41e09bc35d0a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:07.433109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7a35b-09ad-4482-ba76-aa5eb6ec8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.434002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7a35b-09ad-4482-ba76-aa5eb6ec8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.434282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7a35b-09ad-4482-ba76-aa5eb6ec8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.434561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7a35b-09ad-4482-ba76-aa5eb6ec8cb6 None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.435812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7a35b-09ad-4482-ba76-aa5eb6ec8cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=806d7f44013d461582c2f0bde1480beb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.437299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7a35b-09ad-4482-ba76-aa5eb6ec8cb6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.439030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 562/1097] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:07 2022] GET /identity/v3/projects/806d7f44013d461582c2f0bde1480beb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:07.446010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:07.550267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0163-c95a-43c2-9e12-f0bee275c0cd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:07.584462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814feccf-2ef0-4b3a-914d-530817b218ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:07.585478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814feccf-2ef0-4b3a-914d-530817b218ba None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:07.585755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814feccf-2ef0-4b3a-914d-530817b218ba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:07.586023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814feccf-2ef0-4b3a-914d-530817b218ba None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb/users/8d011e2b63674939a58f2e5fb1e47e9b/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:07.587998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814feccf-2ef0-4b3a-914d-530817b218ba None admin] RBAC: Authorizing `identity:create_grant(project_id=806d7f44013d461582c2f0bde1480beb, user_id=8d011e2b63674939a58f2e5fb1e47e9b, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:07.589461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814feccf-2ef0-4b3a-914d-530817b218ba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:07.602802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 536/1098] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:28:07 2022] PUT /identity/v3/projects/806d7f44013d461582c2f0bde1480beb/users/8d011e2b63674939a58f2e5fb1e47e9b/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:28:09.622612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7106d-b670-40d5-a929-73c7b5e76988 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:09.623427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7106d-b670-40d5-a929-73c7b5e76988 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:09.623427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7106d-b670-40d5-a929-73c7b5e76988 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:09.625640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 563/1099] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:09.631136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:09.631604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:09.631697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:09.649966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:09.651189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:09.677735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:09.724081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 537/1100] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:09.747435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7106d-b670-40d5-a929-73c7b5e76988 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:09.849741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7106d-b670-40d5-a929-73c7b5e76988 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:09.885081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:09.895789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:09.896619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:09.896904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:09.897199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:09.908560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:09.916093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:09.917329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:09.918359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 564/1101] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:09.923570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:10.027452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713731a-b031-4425-bfb9-2f87743c3a96 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:10.063655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:10.064286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:10.064610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:10.064881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:10.065623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:10.065924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:10.067282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:10.076205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 538/1102] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:10.082073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:10.193689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275d12-050a-48b4-b91d-58a428d5dfc5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:10.227096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:10.227984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:10.228264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:10.228566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] PATH_INFO: `/v3/users/8d011e2b63674939a58f2e5fb1e47e9b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:10.229876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] RBAC: Authorizing `identity:get_user(user_id=8d011e2b63674939a58f2e5fb1e47e9b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:10.231331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:10.232967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 565/1103] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:10 2022] GET /identity/v3/users/8d011e2b63674939a58f2e5fb1e47e9b => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:10.239179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:10.265847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:10.347191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5dbc-36d7-477a-b9cb-958bf6876f26 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:10.382263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:10.383082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:10.383410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:10.383716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:10.457789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:10.459260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:10.486516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:10.578403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 539/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:10.584591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:10.644845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:10.699125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e12305-8272-4cf2-8246-a62aac2bfdcd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:10.736685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c530d-814f-4cbe-a1d1-8786e2e632ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:10.737536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c530d-814f-4cbe-a1d1-8786e2e632ce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:10.737818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c530d-814f-4cbe-a1d1-8786e2e632ce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:10.738091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c530d-814f-4cbe-a1d1-8786e2e632ce None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:10.739328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c530d-814f-4cbe-a1d1-8786e2e632ce None admin] RBAC: Authorizing `identity:get_project(project_id=806d7f44013d461582c2f0bde1480beb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:10.740859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c530d-814f-4cbe-a1d1-8786e2e632ce None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:10.742548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 566/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:10 2022] GET /identity/v3/projects/806d7f44013d461582c2f0bde1480beb => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:10.748970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:10.852101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a57cf-4c32-4dd3-84bb-5de5b7dda5bd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:10.888541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:10.906794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:10.907620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:10.907968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:10.908330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:10.909574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=806d7f44013d461582c2f0bde1480beb, user.id=8d011e2b63674939a58f2e5fb1e47e9b) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:10.909954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:10.912162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f7df8-048f-44c8-a61a-dc9bd1ce0c41 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:10.918440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 540/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:10 2022] GET /identity/v3/role_assignments?user.id=8d011e2b63674939a58f2e5fb1e47e9b&scope.project.id=806d7f44013d461582c2f0bde1480beb&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:12.980814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08afd1-5773-449d-a21a-63c4a880a138 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:12.981684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08afd1-5773-449d-a21a-63c4a880a138 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:12.981684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08afd1-5773-449d-a21a-63c4a880a138 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:12.983939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 567/1107] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:12.990224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:12.990888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:12.991033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:13.014683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:13.015876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:13.090890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 541/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:13.115039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08afd1-5773-449d-a21a-63c4a880a138 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:13.232843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08afd1-5773-449d-a21a-63c4a880a138 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:13.260699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:13.276962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964de290-02d1-49b9-ae21-87d823d144e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:13.277747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de290-02d1-49b9-ae21-87d823d144e3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:13.278023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de290-02d1-49b9-ae21-87d823d144e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:13.278291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964de290-02d1-49b9-ae21-87d823d144e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:13.279509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de290-02d1-49b9-ae21-87d823d144e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:13.280990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964de290-02d1-49b9-ae21-87d823d144e3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:13.282565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 568/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:13.288459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:13.395645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5484b8-223f-4470-a6a8-15366e841860 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:13.416983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:13.434910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb49771-4203-4481-8b31-a3c6307c7720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:13.435582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49771-4203-4481-8b31-a3c6307c7720 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:13.435857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49771-4203-4481-8b31-a3c6307c7720 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:13.436130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb49771-4203-4481-8b31-a3c6307c7720 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:13.436871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49771-4203-4481-8b31-a3c6307c7720 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:13.438302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb49771-4203-4481-8b31-a3c6307c7720 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:13.459852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 542/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:28:13 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:28:15.511498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642c0f-5bb9-4779-b0f5-465be1e42ef3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:15.512083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642c0f-5bb9-4779-b0f5-465be1e42ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:15.512083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642c0f-5bb9-4779-b0f5-465be1e42ef3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:15.513432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 569/1111] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:15.519836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:15.520299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:15.520407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:15.539178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:15.540359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:15.609531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 543/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:15.632887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20642c0f-5bb9-4779-b0f5-465be1e42ef3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:15.744726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20642c0f-5bb9-4779-b0f5-465be1e42ef3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:15.783164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:15.784018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:15.784296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:15.784598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] PATH_INFO: `/v3/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:15.786063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] RBAC: Authorizing `identity:get_role(role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:15.787443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:15.788823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 570/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:15 2022] GET /identity/v3/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:15.795212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:15.900507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876b658-a5a8-4040-b4a6-01cf143f0c65 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:15.903003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:15.939493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:15.940366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:15.940687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:15.940958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] PATH_INFO: `/v3/users/0075cc1771d24e95be5a49dc7ea5ed5e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:15.955038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] RBAC: Authorizing `identity:get_user(user_id=0075cc1771d24e95be5a49dc7ea5ed5e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:15.956502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:15.958162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 544/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:15 2022] GET /identity/v3/users/0075cc1771d24e95be5a49dc7ea5ed5e => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:15.964191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:16.026574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:16.075485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f0e1-f5db-44c9-96d1-b5e309bf6713 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:16.111601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277916e-73be-4b85-8181-575155328a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:16.112690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277916e-73be-4b85-8181-575155328a86 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:16.113159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277916e-73be-4b85-8181-575155328a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:16.113602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277916e-73be-4b85-8181-575155328a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:16.190618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277916e-73be-4b85-8181-575155328a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:16.192106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277916e-73be-4b85-8181-575155328a86 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:16.262108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:16.308905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 571/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:16.315287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:16.418908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85116-36ff-484d-bb61-03445973de5e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:16.455627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdb57b-48c4-4598-bf43-e2df3ad49e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:16.456514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdb57b-48c4-4598-bf43-e2df3ad49e85 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:16.456790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdb57b-48c4-4598-bf43-e2df3ad49e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:16.457064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdb57b-48c4-4598-bf43-e2df3ad49e85 None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:16.458297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdb57b-48c4-4598-bf43-e2df3ad49e85 None admin] RBAC: Authorizing `identity:get_project(project_id=806d7f44013d461582c2f0bde1480beb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:16.459820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdb57b-48c4-4598-bf43-e2df3ad49e85 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:16.461534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 545/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:16 2022] GET /identity/v3/projects/806d7f44013d461582c2f0bde1480beb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:28:16.471539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277916e-73be-4b85-8181-575155328a86 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:16.585564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277916e-73be-4b85-8181-575155328a86 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:16.619540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:16.620173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:16.620452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:16.620759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:16.621583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] RBAC: Adding query filter params (role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=806d7f44013d461582c2f0bde1480beb, user.id=0075cc1771d24e95be5a49dc7ea5ed5e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:16.621864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:16.623320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b35f81-cdfe-4ff6-ace2-9599424705ef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:16.628702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 572/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:16 2022] GET /identity/v3/role_assignments?user.id=0075cc1771d24e95be5a49dc7ea5ed5e&scope.project.id=806d7f44013d461582c2f0bde1480beb&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:18.627403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac1cac-4c44-4109-9404-947d516933d9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:18.628286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac1cac-4c44-4109-9404-947d516933d9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:18.628286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac1cac-4c44-4109-9404-947d516933d9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:18.630521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 546/1118] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:18.636856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:18.637595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:18.637763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:18.658956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:18.660150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:18.677233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:18.728821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 573/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:18.751809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac1cac-4c44-4109-9404-947d516933d9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:18.789831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:18.866795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac1cac-4c44-4109-9404-947d516933d9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:18.905410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:18.906257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:18.906539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:18.906812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] PATH_INFO: `/v3/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:18.908411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] RBAC: Authorizing `identity:get_role(role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:18.909821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:18.911181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 547/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:18 2022] GET /identity/v3/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:18.917602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:19.025991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078335e-aa50-4046-9d67-a05c0c8546f6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:19.061093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:19.061957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:19.062240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:19.062517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] PATH_INFO: `/v3/users/0075cc1771d24e95be5a49dc7ea5ed5e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:19.063831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] RBAC: Authorizing `identity:get_user(user_id=0075cc1771d24e95be5a49dc7ea5ed5e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:19.065302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:19.066902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 574/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:18 2022] GET /identity/v3/users/0075cc1771d24e95be5a49dc7ea5ed5e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:19.073219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:19.170353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:19.176568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12954bd7-3836-44af-8179-99dd883e27de None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:19.221782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cf086-32e1-43f8-98a3-0f6e14353a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:19.222640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf086-32e1-43f8-98a3-0f6e14353a5f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:19.222921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf086-32e1-43f8-98a3-0f6e14353a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:19.223189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cf086-32e1-43f8-98a3-0f6e14353a5f None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:19.224416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf086-32e1-43f8-98a3-0f6e14353a5f None admin] RBAC: Authorizing `identity:get_project(project_id=806d7f44013d461582c2f0bde1480beb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:19.226014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cf086-32e1-43f8-98a3-0f6e14353a5f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:19.227705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 548/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:19 2022] GET /identity/v3/projects/806d7f44013d461582c2f0bde1480beb => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:19.234869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:19.264937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:19.344319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664001fe-e1b2-457b-8a4d-24327d38f47d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:19.378694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280c3b-8c47-4632-ba40-e3e56e649d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:19.379569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280c3b-8c47-4632-ba40-e3e56e649d84 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:19.379843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280c3b-8c47-4632-ba40-e3e56e649d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:19.380106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280c3b-8c47-4632-ba40-e3e56e649d84 None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb/users/0075cc1771d24e95be5a49dc7ea5ed5e/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:19.382721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280c3b-8c47-4632-ba40-e3e56e649d84 None admin] RBAC: Authorizing `identity:create_grant(project_id=806d7f44013d461582c2f0bde1480beb, user_id=0075cc1771d24e95be5a49dc7ea5ed5e, role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:19.384160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280c3b-8c47-4632-ba40-e3e56e649d84 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:19.402092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 575/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:28:19 2022] PUT /identity/v3/projects/806d7f44013d461582c2f0bde1480beb/users/0075cc1771d24e95be5a49dc7ea5ed5e/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:28:21.367588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccb279-0d4a-40d7-b1c5-83abd3a7320c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:21.370641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccb279-0d4a-40d7-b1c5-83abd3a7320c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:21.370641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccb279-0d4a-40d7-b1c5-83abd3a7320c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:21.370641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 549/1124] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:21.376016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:21.376833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:21.376980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:21.396430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:21.397663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:21.470416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 576/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:21.493985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccb279-0d4a-40d7-b1c5-83abd3a7320c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:21.602564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccb279-0d4a-40d7-b1c5-83abd3a7320c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:21.638449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:21.639234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:21.639515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:21.639790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] PATH_INFO: `/v3/roles/f446e1f654064b8fa5227c7a6b304f79` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:21.641410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] RBAC: Authorizing `identity:get_role(role_id=f446e1f654064b8fa5227c7a6b304f79)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:21.642783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:21.644174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 550/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:21 2022] GET /identity/v3/roles/f446e1f654064b8fa5227c7a6b304f79 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:21.650620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:21.662499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:21.756554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e68f5-cbf2-4360-b17e-4939d51aa6f5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:21.791112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:21.791972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:21.792247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:21.792510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] PATH_INFO: `/v3/users/0075cc1771d24e95be5a49dc7ea5ed5e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:21.793817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] RBAC: Authorizing `identity:get_user(user_id=0075cc1771d24e95be5a49dc7ea5ed5e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:21.795258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:21.796886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 577/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:21 2022] GET /identity/v3/users/0075cc1771d24e95be5a49dc7ea5ed5e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:21.803468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:21.841051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:21.911856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a1ee-ebf6-4f70-8379-7654b683e6f5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:21.949532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:21.950178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:21.950481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:21.950755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:22.019044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:22.020521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:22.053301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:22.132767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 551/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:22.139183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:22.228507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:22.259837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4783-c846-41ed-9082-9026f0b26a6a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:22.294780 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e012b-7df1-45af-bce3-ddcd4048fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:22.295654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e012b-7df1-45af-bce3-ddcd4048fc2d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:22.295930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e012b-7df1-45af-bce3-ddcd4048fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:22.296197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e012b-7df1-45af-bce3-ddcd4048fc2d None admin] PATH_INFO: `/v3/projects/806d7f44013d461582c2f0bde1480beb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:22.297383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e012b-7df1-45af-bce3-ddcd4048fc2d None admin] RBAC: Authorizing `identity:get_project(project_id=806d7f44013d461582c2f0bde1480beb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:22.298825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e012b-7df1-45af-bce3-ddcd4048fc2d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:22.300707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 578/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:22 2022] GET /identity/v3/projects/806d7f44013d461582c2f0bde1480beb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:22.307049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:22.406270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648da329-e029-4cc3-88f6-1256ac5aadb0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:22.441125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:22.441789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:22.442063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:22.442675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:22.443540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] RBAC: Adding query filter params (role.id=f446e1f654064b8fa5227c7a6b304f79, scope.project.id=806d7f44013d461582c2f0bde1480beb, user.id=0075cc1771d24e95be5a49dc7ea5ed5e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:22.443859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:22.445316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcb5ce-4213-4ba5-a69c-b39073ffdf6c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:22.447223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:22.451856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 552/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:22 2022] GET /identity/v3/role_assignments?user.id=0075cc1771d24e95be5a49dc7ea5ed5e&scope.project.id=806d7f44013d461582c2f0bde1480beb&role.id=f446e1f654064b8fa5227c7a6b304f79 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:24.462214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15de86-863a-472d-8edb-a6dd8e7f1175 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:24.463027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15de86-863a-472d-8edb-a6dd8e7f1175 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:24.463161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15de86-863a-472d-8edb-a6dd8e7f1175 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:24.465402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 579/1131] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:24.471637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:24.472062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:24.472208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:24.490370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:24.491533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:24.562704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 553/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:24.586814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15de86-863a-472d-8edb-a6dd8e7f1175 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:24.696446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15de86-863a-472d-8edb-a6dd8e7f1175 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:24.731533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c4330-2015-46cf-839f-c429bc78d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:24.732312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4330-2015-46cf-839f-c429bc78d345 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:24.732625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4330-2015-46cf-839f-c429bc78d345 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:24.732901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c4330-2015-46cf-839f-c429bc78d345 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:24.734180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c4330-2015-46cf-839f-c429bc78d345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:24.735634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c4330-2015-46cf-839f-c429bc78d345 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:24.737256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 580/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:24.744382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:24.856370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb093a4-7a58-4ebe-87db-7605186d09fc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:24.893043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:24.903909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851f53-864e-4234-b8aa-4e868db27df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:24.904618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f53-864e-4234-b8aa-4e868db27df4 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:24.904905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f53-864e-4234-b8aa-4e868db27df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:24.905184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851f53-864e-4234-b8aa-4e868db27df4 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:24.905908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f851f53-864e-4234-b8aa-4e868db27df4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:24.907359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f851f53-864e-4234-b8aa-4e868db27df4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:24.935888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 554/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:28:24 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:28:26.981840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40168d-6e99-48c1-a88c-7f13d1d217b1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:26.982405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40168d-6e99-48c1-a88c-7f13d1d217b1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:26.982405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40168d-6e99-48c1-a88c-7f13d1d217b1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:26.983755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 581/1135] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:26.990394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:26.990837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:26.990927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:27.009023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:27.010215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:27.080541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 555/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:27.105414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40168d-6e99-48c1-a88c-7f13d1d217b1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:27.122330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:27.219282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40168d-6e99-48c1-a88c-7f13d1d217b1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:27.253617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b237-a723-4ad2-ac79-9af16523252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:27.254336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b237-a723-4ad2-ac79-9af16523252b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:27.254619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b237-a723-4ad2-ac79-9af16523252b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:27.254894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b237-a723-4ad2-ac79-9af16523252b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:27.256163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b237-a723-4ad2-ac79-9af16523252b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:27.257644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b237-a723-4ad2-ac79-9af16523252b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:27.259256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 582/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:28:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:27.267898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:27.372497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f0c7a-20d6-447a-9677-58d359a1b736 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:27.383203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:27.409317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc828a-a649-4aae-a583-89102f2893a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:27.410007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc828a-a649-4aae-a583-89102f2893a4 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:27.410288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc828a-a649-4aae-a583-89102f2893a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:27.410564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc828a-a649-4aae-a583-89102f2893a4 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:27.411280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc828a-a649-4aae-a583-89102f2893a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:27.412817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc828a-a649-4aae-a583-89102f2893a4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:27.435307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 556/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:28:27 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:28:29.515749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9a768-2c6a-4171-ad31-8378c030f4fa None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:29.516305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9a768-2c6a-4171-ad31-8378c030f4fa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:29.516305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9a768-2c6a-4171-ad31-8378c030f4fa None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:29.517687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 583/1139] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:29.524040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:29.524879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:29.525023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:29.546876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:29.548103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:29.620019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 557/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:29.647991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9a768-2c6a-4171-ad31-8378c030f4fa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:29.758146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:29.778094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9a768-2c6a-4171-ad31-8378c030f4fa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:29.812575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:29.813365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:29.813641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:29.813909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:29.824927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:29.832329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:29.833480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:29.834516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 584/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:29.840803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:29.947330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:29.955742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eb5a5-33a2-4278-bef1-e94b7b71ab84 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:29.991941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:29.992640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:29.992915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:29.993184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:29.993925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:29.994241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:29.995603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:30.003729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 558/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:30.009868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:30.131670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0c3c1-0339-42fd-bcdf-df255d4a972c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:30.166470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:30.167351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:30.167632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:30.167904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] PATH_INFO: `/v3/users/49f0485a9b884a99a2bb76e556d838b1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:30.179858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:30.182770 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] RBAC: Authorizing `identity:get_user(user_id=49f0485a9b884a99a2bb76e556d838b1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:30.185105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:30.187302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 585/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:30 2022] GET /identity/v3/users/49f0485a9b884a99a2bb76e556d838b1 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:30.195830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:30.299694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b0826-a1bc-4aa4-bbdb-4cdf64dad410 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:30.334620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:30.335255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:30.335541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:30.335811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:30.362777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:30.413695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:30.415184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:30.518669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 559/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:30.526341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:30.631329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd1465-1d21-42a1-b175-39b3fab27b69 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:30.666214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2c9a5-5090-4f0f-9f70-0616f4b811e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:30.667061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c9a5-5090-4f0f-9f70-0616f4b811e6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:30.667343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c9a5-5090-4f0f-9f70-0616f4b811e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:30.667614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2c9a5-5090-4f0f-9f70-0616f4b811e6 None admin] PATH_INFO: `/v3/projects/a470bc7418c54da3bd3502c36a9e779c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:30.668944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2c9a5-5090-4f0f-9f70-0616f4b811e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a470bc7418c54da3bd3502c36a9e779c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:30.670395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2c9a5-5090-4f0f-9f70-0616f4b811e6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:30.672062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 586/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:30 2022] GET /identity/v3/projects/a470bc7418c54da3bd3502c36a9e779c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:30.680957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:30.739369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:30.785593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67a782-1480-42d2-a452-eb8659f948c8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:30.820785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:30.821420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:30.821696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:30.821963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:30.822791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=a470bc7418c54da3bd3502c36a9e779c, user.id=49f0485a9b884a99a2bb76e556d838b1) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:30.823104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:30.824525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a723d-47f9-4b6e-b933-ea904ca83ec2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:30.830086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 560/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:30 2022] GET /identity/v3/role_assignments?user.id=49f0485a9b884a99a2bb76e556d838b1&scope.project.id=a470bc7418c54da3bd3502c36a9e779c&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:32.819410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47d647-6b8d-4116-bed0-2078d607b136 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:32.819985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47d647-6b8d-4116-bed0-2078d607b136 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:32.819985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47d647-6b8d-4116-bed0-2078d607b136 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:32.821353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 587/1147] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:32.827847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:32.828552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:32.828737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:32.850151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:32.851339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:32.927439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 561/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:32.963281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47d647-6b8d-4116-bed0-2078d607b136 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:33.033827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:33.077281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47d647-6b8d-4116-bed0-2078d607b136 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:33.111658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:33.112435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:33.112746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:33.113016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:33.122937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:33.130384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:33.131450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:33.132400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 588/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:33.140055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:33.203155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:33.250055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6a337-b179-4e46-887e-e67640f7202c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:33.286213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:33.286878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:33.287156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:33.287426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:33.288245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:33.288577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:33.289939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:33.298121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 562/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:33.304975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:33.419969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19d09-3210-4b7b-8e10-443adb1bd5ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:33.446772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:33.456587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:33.457469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:33.457747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:33.458007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] PATH_INFO: `/v3/users/49f0485a9b884a99a2bb76e556d838b1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:33.459225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] RBAC: Authorizing `identity:get_user(user_id=49f0485a9b884a99a2bb76e556d838b1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:33.460742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:33.462390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 589/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:33 2022] GET /identity/v3/users/49f0485a9b884a99a2bb76e556d838b1 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:33.469004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:33.568150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7d0ce-95c5-47ef-8392-62ee6bd86f3e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:33.586516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:33.609703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10242064-d895-4377-aebd-9a5893df5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:33.610574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242064-d895-4377-aebd-9a5893df5cec None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:33.610857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242064-d895-4377-aebd-9a5893df5cec None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:33.611135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10242064-d895-4377-aebd-9a5893df5cec None admin] PATH_INFO: `/v3/projects/a470bc7418c54da3bd3502c36a9e779c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:33.612502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242064-d895-4377-aebd-9a5893df5cec None admin] RBAC: Authorizing `identity:get_project(project_id=a470bc7418c54da3bd3502c36a9e779c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:33.613948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10242064-d895-4377-aebd-9a5893df5cec None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:33.615635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 563/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:33 2022] GET /identity/v3/projects/a470bc7418c54da3bd3502c36a9e779c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:33.621836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:33.725524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82018c28-e2b5-481f-94fb-7134f68b640b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:33.762441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779cf0b-f173-45c8-8136-a009e46aa33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:33.763324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779cf0b-f173-45c8-8136-a009e46aa33d None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:33.763602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779cf0b-f173-45c8-8136-a009e46aa33d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:33.763869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779cf0b-f173-45c8-8136-a009e46aa33d None admin] PATH_INFO: `/v3/projects/a470bc7418c54da3bd3502c36a9e779c/users/49f0485a9b884a99a2bb76e556d838b1/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:33.766085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779cf0b-f173-45c8-8136-a009e46aa33d None admin] RBAC: Authorizing `identity:create_grant(project_id=a470bc7418c54da3bd3502c36a9e779c, user_id=49f0485a9b884a99a2bb76e556d838b1, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:33.767532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779cf0b-f173-45c8-8136-a009e46aa33d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:33.781138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 590/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:28:33 2022] PUT /identity/v3/projects/a470bc7418c54da3bd3502c36a9e779c/users/49f0485a9b884a99a2bb76e556d838b1/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:28:35.779536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d19f-215b-427e-a84e-ed8ee09a3cfd None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:35.780349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d19f-215b-427e-a84e-ed8ee09a3cfd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:35.780349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d19f-215b-427e-a84e-ed8ee09a3cfd None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:35.782489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 564/1154] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:35.787858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:35.788279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:35.788395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:35.807125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:35.808309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:35.860399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:35.879122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 591/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:35.909652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d19f-215b-427e-a84e-ed8ee09a3cfd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:36.014355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d19f-215b-427e-a84e-ed8ee09a3cfd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:36.049137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:36.049918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:36.050192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:36.050461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:36.061333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:36.069209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:36.070268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:36.071282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 565/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:36.078757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:36.189218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aadb-11ed-47a9-996b-8d30662be511 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:36.234222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:36.235189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:36.235606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:36.236044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:36.237246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:36.237683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:36.239177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:36.247360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 592/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:36.254133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:36.302267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:36.360873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65708bd-0d9e-470e-9c47-900bd57d51ae None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:36.395280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:36.396141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:36.396420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:36.396712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] PATH_INFO: `/v3/users/49f0485a9b884a99a2bb76e556d838b1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:36.397973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] RBAC: Authorizing `identity:get_user(user_id=49f0485a9b884a99a2bb76e556d838b1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:36.399422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:36.401073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 566/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:36 2022] GET /identity/v3/users/49f0485a9b884a99a2bb76e556d838b1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:36.407158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:36.458738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:36.512042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6a358-d3a5-4187-acb7-5473c311f088 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:36.552914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:36.553472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:36.553823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:36.554092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:36.623288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:36.624783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:36.671928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:36.723498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 593/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:36.733043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:36.843435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b3539-8be3-4bbc-84ef-a8a2813306ab None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:36.853498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:36.879197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ba468-872d-43cd-9c47-9635e6747efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:36.880060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba468-872d-43cd-9c47-9635e6747efb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:36.880336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba468-872d-43cd-9c47-9635e6747efb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:36.880639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ba468-872d-43cd-9c47-9635e6747efb None admin] PATH_INFO: `/v3/projects/a470bc7418c54da3bd3502c36a9e779c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:36.881997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba468-872d-43cd-9c47-9635e6747efb None admin] RBAC: Authorizing `identity:get_project(project_id=a470bc7418c54da3bd3502c36a9e779c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:36.883435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ba468-872d-43cd-9c47-9635e6747efb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:36.885147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 567/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:36 2022] GET /identity/v3/projects/a470bc7418c54da3bd3502c36a9e779c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:36.891479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:36.993076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480dbb-4e26-4809-aaa1-201f96b71d28 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:37.028744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:37.029384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:37.029657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:37.029924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:37.030747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=a470bc7418c54da3bd3502c36a9e779c, user.id=49f0485a9b884a99a2bb76e556d838b1) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:37.031052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:37.032508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3412-842e-4269-bf29-ff7f8f21ccda None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:37.038399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 594/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:36 2022] GET /identity/v3/role_assignments?user.id=49f0485a9b884a99a2bb76e556d838b1&scope.project.id=a470bc7418c54da3bd3502c36a9e779c&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:39.047328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba50b-76f0-44c8-97d0-ef4d0d0fe444 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:39.047875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba50b-76f0-44c8-97d0-ef4d0d0fe444 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:39.047875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba50b-76f0-44c8-97d0-ef4d0d0fe444 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:39.050226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 568/1162] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:39.058005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:39.058412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:39.058627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:39.085566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:39.086757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:39.094198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:39.159149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 595/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:39.182005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba50b-76f0-44c8-97d0-ef4d0d0fe444 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:39.300655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba50b-76f0-44c8-97d0-ef4d0d0fe444 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:39.336489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:39.337143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:39.337420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:39.337693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:39.384118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:39.417467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:39.418929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:39.531837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 569/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:39.538932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:39.659418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb40365-31b9-42bf-95a4-166e7e8e2d9d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:39.694765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:39.695563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:39.695843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:39.696118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:39.703640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:39.705167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-484e8ea6-6f58-4edc-b45b-f927f9696fb6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:39.719867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:39.721143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:39.722008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 596/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:28:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:39.728852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:39.808451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:39.831416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc08fcb-9d37-4a32-a28a-98f8bfaaefda None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:39.868154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:39.868830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:39.869108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:39.869382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:39.870111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:39.870416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:39.871790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32aa88-a461-4416-b195-7caa1219368a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:39.880345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 570/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Thu Jul 21 05:28:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:41.881669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30a45-2110-4173-b49b-5fed737ddd58 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:41.882604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30a45-2110-4173-b49b-5fed737ddd58 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:41.882604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30a45-2110-4173-b49b-5fed737ddd58 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:41.884776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 597/1167] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:41.893590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c954eb-1871-40ef-8703-89e3acf2ec9d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:41.894026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c954eb-1871-40ef-8703-89e3acf2ec9d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:41.894185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c954eb-1871-40ef-8703-89e3acf2ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:41.914043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-98c954eb-1871-40ef-8703-89e3acf2ec9d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:41.915240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-98c954eb-1871-40ef-8703-89e3acf2ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:41.988089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 571/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:42.025006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b30a45-2110-4173-b49b-5fed737ddd58 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:42.032023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:42.138357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b30a45-2110-4173-b49b-5fed737ddd58 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:42.172583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817840b9-cff9-4fe8-96c7-50f3d7cc751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:42.173238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817840b9-cff9-4fe8-96c7-50f3d7cc751f None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:42.173516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817840b9-cff9-4fe8-96c7-50f3d7cc751f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:42.173786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817840b9-cff9-4fe8-96c7-50f3d7cc751f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:42.174511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817840b9-cff9-4fe8-96c7-50f3d7cc751f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:42.175884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817840b9-cff9-4fe8-96c7-50f3d7cc751f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:42.195282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 598/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Thu Jul 21 05:28:42 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:28:44.249536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6cbcf-bfca-464d-9831-86639818c7bc None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:44.250100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6cbcf-bfca-464d-9831-86639818c7bc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:44.250100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6cbcf-bfca-464d-9831-86639818c7bc None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:44.251462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 572/1170] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:44.258113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:44.258871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:44.259001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:44.282193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:44.283384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:44.343218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:44.355658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 599/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:44.379401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6cbcf-bfca-464d-9831-86639818c7bc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:44.459641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:44.488608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6cbcf-bfca-464d-9831-86639818c7bc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:44.524110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84562b71-1047-48fc-8f6c-ae0fc4747655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:44.524949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84562b71-1047-48fc-8f6c-ae0fc4747655 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:44.525230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84562b71-1047-48fc-8f6c-ae0fc4747655 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:44.525498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84562b71-1047-48fc-8f6c-ae0fc4747655 None admin] PATH_INFO: `/v3/domains/cbf65d39384d4f3b8299ee414b241786` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:44.536164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84562b71-1047-48fc-8f6c-ae0fc4747655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cbf65d39384d4f3b8299ee414b241786)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:44.537661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84562b71-1047-48fc-8f6c-ae0fc4747655 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:44.539349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 573/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jul 21 05:28:44 2022] GET /identity/v3/domains/cbf65d39384d4f3b8299ee414b241786 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:44.545524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:44.649786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf523ad-86fd-4cb5-b08b-a05b132dca4a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:44.687768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8db2d-e6c0-4c32-aa9d-be96101459ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:44.688420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8db2d-e6c0-4c32-aa9d-be96101459ff None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:44.688751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8db2d-e6c0-4c32-aa9d-be96101459ff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:44.689024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8db2d-e6c0-4c32-aa9d-be96101459ff None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:44.689736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8db2d-e6c0-4c32-aa9d-be96101459ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:44.691521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8db2d-e6c0-4c32-aa9d-be96101459ff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:44.720645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 600/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:28:44 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:28:46.765963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fe44d-c8b1-415c-9519-21364a91eae3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:46.766806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fe44d-c8b1-415c-9519-21364a91eae3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:46.766806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fe44d-c8b1-415c-9519-21364a91eae3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:46.768906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 574/1174] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:46.777769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:46.778210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:46.778344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:46.800282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:46.801506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:46.846625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:46.872966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 601/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:46.898196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fe44d-c8b1-415c-9519-21364a91eae3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:47.011755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fe44d-c8b1-415c-9519-21364a91eae3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:47.043767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:47.049883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acb958-d9d5-4ca4-a382-058e53bcb5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:47.050759 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acb958-d9d5-4ca4-a382-058e53bcb5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:47.051038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acb958-d9d5-4ca4-a382-058e53bcb5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:47.051305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acb958-d9d5-4ca4-a382-058e53bcb5c3 None admin] PATH_INFO: `/v3/domains/cbf65d39384d4f3b8299ee414b241786` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:47.052614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acb958-d9d5-4ca4-a382-058e53bcb5c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cbf65d39384d4f3b8299ee414b241786)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:47.054163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acb958-d9d5-4ca4-a382-058e53bcb5c3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:47.055809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 575/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Thu Jul 21 05:28:46 2022] GET /identity/v3/domains/cbf65d39384d4f3b8299ee414b241786 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:47.061883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:47.163565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e2734-f589-45d7-bce3-08b12c1400fd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:47.201412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafc560-0f23-4964-a4c4-8ce4707b505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:47.202085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc560-0f23-4964-a4c4-8ce4707b505e None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:47.202368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc560-0f23-4964-a4c4-8ce4707b505e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:47.202642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafc560-0f23-4964-a4c4-8ce4707b505e None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:47.203353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc560-0f23-4964-a4c4-8ce4707b505e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:47.204843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafc560-0f23-4964-a4c4-8ce4707b505e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:47.226605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 602/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:28:47 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:28:49.268343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e5cf9-6f1b-450d-b2d4-f84dd09d3151 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:49.268977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e5cf9-6f1b-450d-b2d4-f84dd09d3151 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:49.268977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e5cf9-6f1b-450d-b2d4-f84dd09d3151 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:49.270294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 576/1178] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:49.276817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:49.277502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:49.277683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:49.305843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:49.307052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:49.331838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:49.381172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 603/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:49.405160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e5cf9-6f1b-450d-b2d4-f84dd09d3151 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:49.519841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e5cf9-6f1b-450d-b2d4-f84dd09d3151 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:49.560530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:49.561360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:49.561645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:49.561921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:49.573083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:49.580638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:49.581774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:49.582690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 577/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:49.588527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:49.690172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83e020-9dac-41df-9d03-1e0f129e529c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:49.726036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:49.726701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:49.726962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:49.727265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:49.728009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:49.728323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:49.729742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:49.737895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 604/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:49.744625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:49.813884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:49.858206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194d3e-bc3e-4335-9170-77374fabd4a9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:49.893346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:49.894219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:49.894499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:49.894776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] PATH_INFO: `/v3/users/2ae57e8037d244fd818b3747c25028ca` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:49.908744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] RBAC: Authorizing `identity:get_user(user_id=2ae57e8037d244fd818b3747c25028ca)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:49.910196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:49.911827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 578/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:49 2022] GET /identity/v3/users/2ae57e8037d244fd818b3747c25028ca => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:49.918339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:49.944201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:50.019915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b36aa-2541-4f1e-8626-78c92ef0aa47 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:50.055036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:50.055682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:50.055967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:50.056225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:50.138123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:50.139502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:50.163825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:50.243157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 605/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:50.249997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:50.362161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde81831-26bd-40fb-aee3-94dc800f571f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:50.379631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:50.401065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef0f7f-d35f-4714-abb7-01f39fa5ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:50.401862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0f7f-d35f-4714-abb7-01f39fa5ce67 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:50.402141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0f7f-d35f-4714-abb7-01f39fa5ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:50.402413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef0f7f-d35f-4714-abb7-01f39fa5ce67 None admin] PATH_INFO: `/v3/projects/1408c61fc28a49a7b8c466c50656bc4f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:50.403674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef0f7f-d35f-4714-abb7-01f39fa5ce67 None admin] RBAC: Authorizing `identity:get_project(project_id=1408c61fc28a49a7b8c466c50656bc4f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:50.405148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef0f7f-d35f-4714-abb7-01f39fa5ce67 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:50.406856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 579/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:50 2022] GET /identity/v3/projects/1408c61fc28a49a7b8c466c50656bc4f => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:50.413946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:50.525208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8a213-2647-4d1e-b5da-555f4f79a687 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:50.552672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:50.565008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:50.565666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:50.566291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:50.566567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:50.567380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=1408c61fc28a49a7b8c466c50656bc4f, user.id=2ae57e8037d244fd818b3747c25028ca) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:50.567729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:50.569210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b004c9a-5c38-4536-b6e0-6883377b83c6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:50.574784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 606/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:50 2022] GET /identity/v3/role_assignments?user.id=2ae57e8037d244fd818b3747c25028ca&scope.project.id=1408c61fc28a49a7b8c466c50656bc4f&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:52.577509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205ccc9-31d5-4338-9e8f-b830ef391755 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:52.578068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205ccc9-31d5-4338-9e8f-b830ef391755 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:52.578068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205ccc9-31d5-4338-9e8f-b830ef391755 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:52.579422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 580/1186] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:52.585899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:52.586590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:52.586727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:52.611972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:52.613734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:52.687314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 607/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:52.710376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205ccc9-31d5-4338-9e8f-b830ef391755 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:52.837647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205ccc9-31d5-4338-9e8f-b830ef391755 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:52.872271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:52.873073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:52.873350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:52.873618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:52.884074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:52.891574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:52.892707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:28:52.893995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 581/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:52.898789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:53.000410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f95cb-4499-460c-8f48-efe52856faeb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:53.016759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:53.037340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:53.038005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:53.038309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:53.038583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:53.039317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:53.039616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:53.041018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:53.049853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 608/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:53.056535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:53.116462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:53.172544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7077a5f-ef9d-4423-8290-ed6ba292ad17 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:53.214085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:53.214962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:53.215241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:53.215511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] PATH_INFO: `/v3/users/2ae57e8037d244fd818b3747c25028ca` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:53.216928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] RBAC: Authorizing `identity:get_user(user_id=2ae57e8037d244fd818b3747c25028ca)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:53.218381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:53.220016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 582/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:53 2022] GET /identity/v3/users/2ae57e8037d244fd818b3747c25028ca => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:53.226357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:53.333445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe7f9d-4e71-497f-9594-2329bf44f016 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:53.367419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a813c-571e-42a6-8002-511e4cac5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:53.368268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a813c-571e-42a6-8002-511e4cac5f6c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:53.368554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a813c-571e-42a6-8002-511e4cac5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:53.368856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a813c-571e-42a6-8002-511e4cac5f6c None admin] PATH_INFO: `/v3/projects/1408c61fc28a49a7b8c466c50656bc4f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:53.370071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a813c-571e-42a6-8002-511e4cac5f6c None admin] RBAC: Authorizing `identity:get_project(project_id=1408c61fc28a49a7b8c466c50656bc4f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:53.371515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a813c-571e-42a6-8002-511e4cac5f6c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:53.373193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 609/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:53 2022] GET /identity/v3/projects/1408c61fc28a49a7b8c466c50656bc4f => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:53.379902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:53.489007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5c30f-8087-46d1-a93b-99d2020fccce None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:53.502725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:53.525228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd03ac3-b931-4a12-821f-4abf4d6d44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:53.526127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03ac3-b931-4a12-821f-4abf4d6d44e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:53.526407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03ac3-b931-4a12-821f-4abf4d6d44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:53.526681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03ac3-b931-4a12-821f-4abf4d6d44e5 None admin] PATH_INFO: `/v3/projects/1408c61fc28a49a7b8c466c50656bc4f/users/2ae57e8037d244fd818b3747c25028ca/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:53.528921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd03ac3-b931-4a12-821f-4abf4d6d44e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1408c61fc28a49a7b8c466c50656bc4f, user_id=2ae57e8037d244fd818b3747c25028ca, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:53.530376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd03ac3-b931-4a12-821f-4abf4d6d44e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:53.546247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 583/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:28:53 2022] PUT /identity/v3/projects/1408c61fc28a49a7b8c466c50656bc4f/users/2ae57e8037d244fd818b3747c25028ca/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:28:55.528992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15632e9-4974-470f-9fa0-ab33af714e73 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:55.529574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15632e9-4974-470f-9fa0-ab33af714e73 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:55.529574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15632e9-4974-470f-9fa0-ab33af714e73 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:55.530930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 610/1193] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:28:55.537369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:55.538079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:55.538269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:55.562182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:28:55.563368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:28:55.633693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 584/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:28:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:28:55.669014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15632e9-4974-470f-9fa0-ab33af714e73 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:55.723678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:55.780093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15632e9-4974-470f-9fa0-ab33af714e73 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:55.820022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:55.820853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:55.821133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:55.821405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:55.832941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:28:55.840519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:28:55.841611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:28:55.842652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 611/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:28:55.848300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:55.951956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a244b6-d6d8-4689-b2cd-df9d67ede93b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:55.954296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:55.989797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:55.990394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:55.990670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:55.990943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:55.991778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:55.992094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:55.993501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:56.001808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 585/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:56.007610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:56.117155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc31f9-e5f0-4796-9ec9-d0b1315122ed None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:56.124085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:56.153198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:56.154078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:56.154362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:56.154633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] PATH_INFO: `/v3/users/2ae57e8037d244fd818b3747c25028ca` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:56.155947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] RBAC: Authorizing `identity:get_user(user_id=2ae57e8037d244fd818b3747c25028ca)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:56.157446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:56.159085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 612/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Thu Jul 21 05:28:56 2022] GET /identity/v3/users/2ae57e8037d244fd818b3747c25028ca => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:56.165818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:56.271918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92a9-e262-4b1a-bd90-7834803e25d0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:56.306795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:56.307430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:56.307705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:56.307978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:56.344929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:56.381157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:56.382690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:56.482727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 586/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:28:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:28:56.491793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:56.598256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e075b-5a85-49f7-9a34-864b6b67de1a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:56.633906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1187-7f81-4f84-a616-513dbd6df30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:56.634773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1187-7f81-4f84-a616-513dbd6df30d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:56.635056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1187-7f81-4f84-a616-513dbd6df30d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:56.635333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1187-7f81-4f84-a616-513dbd6df30d None admin] PATH_INFO: `/v3/projects/1408c61fc28a49a7b8c466c50656bc4f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:56.636627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1187-7f81-4f84-a616-513dbd6df30d None admin] RBAC: Authorizing `identity:get_project(project_id=1408c61fc28a49a7b8c466c50656bc4f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:56.638077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1187-7f81-4f84-a616-513dbd6df30d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:56.639756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 613/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Thu Jul 21 05:28:56 2022] GET /identity/v3/projects/1408c61fc28a49a7b8c466c50656bc4f => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:28:56.648972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:28:56.723144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:28:56.760821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b00e3-a162-4a36-9d14-5682ca775a9c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:28:56.796634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:28:56.797284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:28:56.797572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:28:56.797838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:28:56.798667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=1408c61fc28a49a7b8c466c50656bc4f, user.id=2ae57e8037d244fd818b3747c25028ca) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:28:56.798978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:28:56.800404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796b309-1f32-4964-9294-3d046e06d457 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:28:56.806417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 587/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:28:56 2022] GET /identity/v3/role_assignments?user.id=2ae57e8037d244fd818b3747c25028ca&scope.project.id=1408c61fc28a49a7b8c466c50656bc4f&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:29:06.628522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=79 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:06.803725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=35 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:51.800874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccec0-c3cb-43e2-bda6-aa67dd889f6f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:51.800874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccec0-c3cb-43e2-bda6-aa67dd889f6f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:51.800874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccec0-c3cb-43e2-bda6-aa67dd889f6f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:51.800874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 614/1201] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:29:51.806912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:51.807403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:51.807534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:51.826492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:29:51.828366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:29:51.915815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 588/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:29:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:29:51.944080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccec0-c3cb-43e2-bda6-aa67dd889f6f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:52.078259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccec0-c3cb-43e2-bda6-aa67dd889f6f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:52.116935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:52.117751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:52.118038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:52.118340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:52.130433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:52.131918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:29:52.150981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:52.152110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:52.153157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:29:52.153157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:29:52.153157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:29:52.153157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:29:52.153157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 615/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:29:52.158788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:52.290354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67982c-37bc-4894-ad2b-d9b878e9961a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:52.329808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:52.340948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:52.341648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:52.341932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:52.342244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:52.343009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:52.343313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:52.344804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0baaf-981f-4b2d-8f7f-b497220b6c7d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:52.358721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 589/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:29:52.365126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:52.430989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:52.490470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6190bd-0d96-4b4d-91b8-e1d68840780a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:52.534683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a690-801c-4783-a497-231fe255c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:52.535654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a690-801c-4783-a497-231fe255c063 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:52.536112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a690-801c-4783-a497-231fe255c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:52.536400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a690-801c-4783-a497-231fe255c063 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:52.537134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2a690-801c-4783-a497-231fe255c063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:52.538700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2a690-801c-4783-a497-231fe255c063 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:52.561020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 616/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Thu Jul 21 05:29:52 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:29:54.925202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be041-7872-4003-9e2c-f34183258895 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:54.925768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be041-7872-4003-9e2c-f34183258895 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:54.925768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be041-7872-4003-9e2c-f34183258895 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:54.928509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 590/1206] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:29:54.933223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:54.933718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:54.933813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:54.955004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:29:54.956328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:29:55.039410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 617/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:29:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:29:55.064760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57be041-7872-4003-9e2c-f34183258895 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:55.181565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57be041-7872-4003-9e2c-f34183258895 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:55.223965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:55.224928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:55.225211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:55.225483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:55.239916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:29:55.249538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:55.252033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:29:55.252966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 591/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:29:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:29:55.257998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:55.303196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:55.367926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dcf25-3e80-45df-a094-53de86b39675 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:55.403186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:55.403863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:55.404155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:55.404411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:55.407560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:55.407560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:55.407560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:55.415482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 618/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:29:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:29:55.423623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:55.479589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:55.536110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa107d-7a75-4a41-94d5-69c3a762cf20 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:55.580671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:55.581514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:55.581819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:55.582064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:55.596375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:55.597815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:29:55.616995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:55.618102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:55.619218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:29:55.619218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:29:55.619218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:29:55.619218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:29:55.623487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 592/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:29:55.624727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:55.733626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:55.737417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a86af-a8df-4f44-b003-6dd08f063054 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:55.778551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:55.780454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:55.780454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:55.780454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:55.780770 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:55.781056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:55.782573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:55.797211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 619/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:29:55.803843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:55.920744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca08c3-ada6-423e-8384-2e5a81e7e5ff None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:55.922452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:55.961105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:55.961994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:55.962296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:55.962566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:55.971493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:55.973041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:29:55.988416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:55.989572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:29:55.990535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 593/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:29:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:29:55.995711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:56.107367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce4753-1b43-4b92-84a2-582ef83ee932 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:56.142803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:56.143887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:56.143887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:56.144174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:56.145203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:56.145516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:56.147095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:56.167396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 620/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jul 21 05:29:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:29:56.173871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:56.295746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb3421-551b-46a6-a499-1a0781b0009f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:56.334564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:56.335228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:56.335507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:56.335781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:56.369840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:56.411105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:56.412816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:56.523306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 594/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:29:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:29:56.524735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:56.547240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:56.640962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45300674-ffc4-42db-a251-d054e5bf5730 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:56.682143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:56.683006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:56.683338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:56.683595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:56.694788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:56.697512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:29:56.716541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:56.717662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:56.718595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:29:56.718595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:29:56.718595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:29:56.718595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:29:56.718595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 621/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:29:56.723727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:56.790597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:56.834496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588fa13-cb18-40f6-8719-69f7b91a6d75 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:56.885686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:56.886862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:56.887375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:56.887658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:56.888398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:56.888833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:56.890509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:56.906183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 595/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:29:56.912675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:57.001991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:57.033932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330064-548d-46d8-b20f-98286681ba99 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:57.071618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:57.072559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:57.072902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:57.073238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:57.080084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:57.081635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:29:57.095952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:57.097169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:29:57.098148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 622/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:29:57.103262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:57.219008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935883d-b07a-4143-80a4-747ca992aac3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:57.249941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:57.266920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:57.267679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:57.267962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:57.268421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:57.269928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:57.270454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:57.272264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e161046-a781-436b-82a5-a6b8b9f37715 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:57.293005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 596/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:29:57.294393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:57.405904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a497312-6ae9-4273-8316-81ab767483fb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:57.440347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:29:57.450693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:57.451406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:57.451687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:57.451965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:57.452863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=2181bb81957a46e6ae1fccf0b32e66fe) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:29:57.453175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:29:57.454620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54233b9-b8e6-47d9-a308-b43e374bb24e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:29:57.460361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 623/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:29:57 2022] GET /identity/v3/role_assignments?user.id=2181bb81957a46e6ae1fccf0b32e66fe&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:29:59.556875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221601-99f9-42f1-8164-d363a4fbd7a4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:59.557722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221601-99f9-42f1-8164-d363a4fbd7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:59.557722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221601-99f9-42f1-8164-d363a4fbd7a4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:59.560985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 597/1220] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:29:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:29:59.567962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:59.568439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:59.568610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:59.589470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:29:59.590823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:29:59.670903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 624/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:29:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:29:59.701877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26221601-99f9-42f1-8164-d363a4fbd7a4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:29:59.821063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26221601-99f9-42f1-8164-d363a4fbd7a4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:29:59.861162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:29:59.862138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:29:59.862466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:29:59.862739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:29:59.874174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:29:59.882388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:29:59.883598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:29:59.890001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 598/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:29:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:29:59.890847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:00.001509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd566-bf4d-40f9-8678-9f1b70954bd7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:00.028258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:00.040593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:00.041280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:00.041653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:00.041936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:00.042822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:00.043126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:00.044613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:00.054314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 625/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:29:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:00.060762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:00.111150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:00.176639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151402-01ae-4518-bbe3-6f48de7473f0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:00.216106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:00.216961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:00.217246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:00.217521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:00.229991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:00.231546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:00.250484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:00.251620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:00.252842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:00.252842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:00.252842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:00.252842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:00.252842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 599/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:00.258234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:00.369467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4c5f-36a8-47bc-86a4-05f51bd862ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:00.409270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:00.409961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:00.410257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:00.410502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:00.411330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:00.411693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:00.413069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:00.433347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 626/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:00.434703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:00.539163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:00.547905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e125a7-5e11-422f-be6e-208b688a8d53 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:00.585107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:00.585914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:00.586188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:00.586458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:00.594020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:00.595461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:30:00.609614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:00.610579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:00.611664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 600/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 05:30:00.617053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:00.670361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:00.735143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf650-942f-4ef3-bd33-8ceeea363f1a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:00.773602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:00.774285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:00.774561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:00.774829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:00.775671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:00.775977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:00.777449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:00.795641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 627/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jul 21 05:30:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:00.801371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:00.915812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0758f9-e16a-49ac-a253-ca934c62094e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:00.951031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:00.951803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:00.952080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:00.952350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:00.966101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:00.967636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:00.985203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:00.986824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:00.988097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:00.988097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:00.988097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:00.988097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:00.988097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 601/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:00.992558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:01.100280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398aadb-de1b-4d4b-818d-ebdbfa97002c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:01.103283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:01.143335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:01.143957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:01.144274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:01.144591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:01.145305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:01.145640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:01.147066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:01.159327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 628/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:01.165305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:01.176648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:01.282063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020758-a767-4ba0-925b-aaa7ef765ded None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:01.318514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:01.319305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:01.319620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:01.319851 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:01.326741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:01.328196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:30:01.342270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:01.343412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:01.344454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 602/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:01.350100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:01.464130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd063e-5d9c-4560-815b-5387a4ae9ecc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:01.498754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:01.499419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:01.499694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:01.499988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:01.500848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:01.501157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:01.502609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e32f8a-166d-43c8-baad-dd9d9add2381 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:01.516646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 629/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:01.522856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:01.599575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:01.641371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68323f-d72b-4811-9183-4071ecc18409 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:01.676504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3fb12-a0c7-41ff-8405-b6b7271076ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:01.677364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3fb12-a0c7-41ff-8405-b6b7271076ef None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:01.677661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3fb12-a0c7-41ff-8405-b6b7271076ef None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:01.677896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3fb12-a0c7-41ff-8405-b6b7271076ef None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/2181bb81957a46e6ae1fccf0b32e66fe/roles/390672798aa8493ead425a9e90ffea6a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:01.693006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3fb12-a0c7-41ff-8405-b6b7271076ef None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=2181bb81957a46e6ae1fccf0b32e66fe, role_id=390672798aa8493ead425a9e90ffea6a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:01.694470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3fb12-a0c7-41ff-8405-b6b7271076ef None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:01.707523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 603/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:30:01 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/2181bb81957a46e6ae1fccf0b32e66fe/roles/390672798aa8493ead425a9e90ffea6a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:30:03.719368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c40f-228f-431f-aabe-3cee45cf4c44 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:03.719908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c40f-228f-431f-aabe-3cee45cf4c44 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:03.719908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c40f-228f-431f-aabe-3cee45cf4c44 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:03.721234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 630/1233] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:03.726560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:03.726973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:03.727157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:03.744445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:03.745658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:03.811655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 604/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:03.836092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c40f-228f-431f-aabe-3cee45cf4c44 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:03.862005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:03.945202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c40f-228f-431f-aabe-3cee45cf4c44 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:03.982772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:03.983498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:03.983777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:03.984046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:03.994682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:30:04.002765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:04.003954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:04.005021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 631/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Thu Jul 21 05:30:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:04.010288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:04.059083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:04.113547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbb7c9-9fe7-4e49-bd16-fef596a1db3c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:04.148664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:04.149350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:04.149633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:04.149908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:04.150664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:04.150981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:04.152364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:04.161280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 605/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Thu Jul 21 05:30:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:04.167827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:04.270625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:04.287999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05253b4-79a9-4614-a539-9d4c1aa5fe0b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:04.324275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:04.325144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:04.325416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:04.325719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:04.338072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:04.340090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:04.360680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:04.361820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:04.362999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:04.362999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:04.362999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:04.362999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:04.366835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 632/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:04.368029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:04.479300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835533e1-9073-45fe-91c9-b4893afcff35 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:04.491419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:04.523212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:04.523841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:04.524336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:04.524675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:04.525464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:04.525772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:04.527547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:04.541502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 606/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:04.548095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:04.658894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1add2-a106-4964-b033-3c771837b9ae None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:04.695651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:04.696463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:04.696769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:04.697043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:04.699741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:04.705349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:04.706862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:30:04.721585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:04.723174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:04.724437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 633/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:04.728766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:04.838227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079cee6-e6ec-4f64-87c0-7b8000503ebe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:04.878926 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:04.879829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:04.880135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:04.880392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:04.881293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:04.881747 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:04.883353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:04.909524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 607/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jul 21 05:30:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:04.910775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:05.019491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af626779-7e8d-4c3a-9bc5-540fa80ac24f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:05.057291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:05.057960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:05.058238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:05.058509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:05.129357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:05.136869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:05.138359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:05.257647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 634/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:30:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:30:05.263841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:05.292605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:05.370205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dded1-ab1f-452e-bb52-f4c92580bdd4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:05.410231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:05.411116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:05.411552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:05.411900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:05.426026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:05.427935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:05.449289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:05.450445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:05.451391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:05.451391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:05.451391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:05.451391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:05.451391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 608/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:05.456920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:05.559047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:05.568399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2964c-3b65-4956-99e1-daf9e65260b3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:05.602885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:05.603746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:05.604000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:05.604268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:05.606050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:05.606050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:05.607370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:05.619501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 635/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:05.625837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:05.710350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:05.735853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a85d64-93e1-44d5-b3f2-5816666fd27c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:05.774806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:05.775611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:05.775892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:05.776161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:05.783000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:05.784641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:30:05.799247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:05.800700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:05.801693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 609/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:05.806506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:05.924813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7855dd9-089e-43ab-94bd-eeb09674e593 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:05.967679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:05.968393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:05.968701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:05.968970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:05.969930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:05.970276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:05.971916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c35d4f-a494-4b35-81ee-db2b24a8fc6e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:05.984861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 636/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:05.991881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:06.112807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b2458-dd1d-4f92-a754-9102a58abc0c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:06.151304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:06.151962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:06.152237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:06.152513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:06.153354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] RBAC: Adding query filter params (role.id=390672798aa8493ead425a9e90ffea6a, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=2181bb81957a46e6ae1fccf0b32e66fe) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:06.153663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:06.155096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30232074-e9e5-41a8-b20a-5183ce0197c2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:06.161127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 610/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:30:05 2022] GET /identity/v3/role_assignments?user.id=2181bb81957a46e6ae1fccf0b32e66fe&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=390672798aa8493ead425a9e90ffea6a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:08.228070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762a431-bfef-4e1f-81aa-cee9b296ba96 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:08.228977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762a431-bfef-4e1f-81aa-cee9b296ba96 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:08.228977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762a431-bfef-4e1f-81aa-cee9b296ba96 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:08.230095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 637/1247] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:08.235665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:08.236138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:08.236248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:08.242801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:08.260042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:08.261914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:08.341617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 611/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 05:30:08.366088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762a431-bfef-4e1f-81aa-cee9b296ba96 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:08.385802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:08.482437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762a431-bfef-4e1f-81aa-cee9b296ba96 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:08.517243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:08.518056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:08.518331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:08.518605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:08.528931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:30:08.536929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:08.538094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:08.539107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 638/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:08.544538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:08.651867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e1830-2e5a-4be4-891d-d7e90345805d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:08.684274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:08.690366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:08.691055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:08.691334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:08.691604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:08.692420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:08.692744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:08.694122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:08.702600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 612/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:08.708748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:08.793994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:08.821650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578c76-2887-40b3-8895-3778f7ce4ea1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:08.859213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:08.860040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:08.860310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:08.861393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:08.871576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:08.873091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:08.891879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:08.893031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:08.894150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:08.894150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:08.894150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:08.894150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:08.894150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 639/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:08.899725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:09.008869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221c11b-a81c-4c39-9bfd-b605f9f45d75 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:09.046832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:09.047430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:09.047708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:09.047980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:09.048746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:09.049053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:09.050480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:09.063986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 613/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:09.069914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:09.178712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abc076-57b5-43bf-9b79-cdca7de45a0a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:09.210112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:09.219679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:09.221151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:09.221433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:09.221765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:09.231886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:09.234414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:30:09.251783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:09.253114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:09.259242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 640/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:09.259972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:09.325353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:09.374377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc619f9-b3dd-4a03-959a-43c092787420 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:09.416732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:09.417524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:09.417817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:09.418152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:09.421889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:09.421889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:09.421889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:09.442582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 614/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jul 21 05:30:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:09.448567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:09.559156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab74ed3-7b74-4480-a167-cefa0075ad50 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:09.598265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:09.598844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:09.599131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:09.599409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:09.669967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:09.684892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:09.686404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:09.795910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 641/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:30:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 05:30:09.801978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:09.909059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9121e-3c66-4b5d-92d0-311a254962af None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:09.924686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:09.948166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:09.949011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:09.949302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:09.949589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:09.961081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:09.962632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:09.981269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:09.982232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:09.983146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:09.983146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:09.983146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:09.983146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:09.983146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 615/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:09.988496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:10.091874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:10.106929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c718-7c5a-4cc4-8773-46a409ff272f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:10.145430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:10.146095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:10.146375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:10.146645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:10.147361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:10.147662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:10.149071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:10.160599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 642/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:10.166279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:10.290018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e74d7-d108-4aa5-9049-be54cf42dc76 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:10.329269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:10.330395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:10.330668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:10.330992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:10.339261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:10.341104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:30:10.357269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:10.358392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:10.359512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:10.363504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 616/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:10.364681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:10.475640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c302225-5993-4d2d-be38-366ad9c147eb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:10.509880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:10.510549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:10.510828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:10.511102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:10.511920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:10.512189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:10.513659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a810c-4f4a-469e-a80c-14c8470a61d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:10.527447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 643/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:10.533381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:10.559782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:10.637675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6600a4-ed48-48d6-9823-c43942a7847d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:10.671115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:10.671817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:10.672077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:10.672368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:10.673453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=2181bb81957a46e6ae1fccf0b32e66fe) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:10.673575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:10.674917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709fd65-9154-4714-9cc4-41363c603efb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:10.680772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 617/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:30:10 2022] GET /identity/v3/role_assignments?user.id=2181bb81957a46e6ae1fccf0b32e66fe&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:12.762071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa418aa-98f7-476e-9c46-af93c0e48182 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:12.763016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa418aa-98f7-476e-9c46-af93c0e48182 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:12.763016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa418aa-98f7-476e-9c46-af93c0e48182 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:12.765043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 644/1261] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:12.771266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:12.771996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:12.772146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:12.800245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:12.801865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:12.879508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 618/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:12.902660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa418aa-98f7-476e-9c46-af93c0e48182 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:12.916875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:13.018499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa418aa-98f7-476e-9c46-af93c0e48182 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:13.053736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:13.054521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:13.054801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:13.055066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:13.066964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:30:13.074454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:13.075622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:13.076771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 645/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:13.081971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:13.102159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:13.185653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3775ee-2168-4f6f-b7eb-dcbdd6720636 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:13.222725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:13.223530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:13.223858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:13.224161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:13.225127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:13.225590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:13.227403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:13.236627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 619/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:30:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:13.243556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:13.315671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:13.358209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5206b-0053-4c14-a0e9-3ee2541d2806 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:13.393734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:13.394551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:13.394872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:13.395152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:13.406221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:13.407688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:13.425368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:13.426465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:13.427565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:13.427565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:13.427565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:13.427565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:13.427565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 646/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:13.432837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:13.516249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:13.546550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f500f20-1962-4e6a-8cbd-1f3f8cd8ce1d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:13.593769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:13.594665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:13.595096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:13.595547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:13.596679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:13.597088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:13.598890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:13.611214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 620/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:13.617467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:13.723398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b88a6-47e2-4040-9ff2-888a88ffc038 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:13.743249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:13.758934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:13.759728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:13.759998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:13.760266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:13.767744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:13.769216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:30:13.783229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:13.784354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:13.785765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:13.788844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 647/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:13.790938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:13.901949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce46ca-0301-4fcd-a007-3eb0974ab0ae None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:13.942708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:13.943365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:13.943650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:13.943931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:13.944805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:13.945116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:13.946553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:13.955395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:13.965097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 621/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jul 21 05:30:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:13.971035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:14.072372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008fc0-6f5b-40de-a350-1cd9c36b88f0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:14.107473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:14.108245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:14.108535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:14.108814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:14.119763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:14.121248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:14.138226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:14.139289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:14.140434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:14.140434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:14.140434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:14.140434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:14.143846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 648/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:14.144979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:14.254199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893709a-c49d-47a2-b2be-44c5a26cf0f5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:14.289035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:14.289695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:14.289972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:14.290245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:14.290965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:14.291270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:14.292662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:14.304173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 622/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:14.310057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:14.343453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:14.434933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe491c8-522c-4256-8ea1-0b232481ef0b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:14.471133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:14.471927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:14.472207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:14.472508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:14.479647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:14.481146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:30:14.495697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:14.496784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:14.497867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 649/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:14.503012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:14.568093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:14.615388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3063d3a-1f45-4ad9-98e3-7b98fd191859 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:14.650297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:14.650947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:14.651228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:14.651502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:14.652285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:14.652626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:14.654064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29c09f-05d5-4c23-b77a-385a57658ce9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:14.666286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 623/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:14.672664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:14.765944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:14.775606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425356e-9b96-4595-a9c4-1d3b9387db79 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:14.812919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390a90-88d5-4b1b-932e-9573c9e37fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:14.813808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390a90-88d5-4b1b-932e-9573c9e37fd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:14.814084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390a90-88d5-4b1b-932e-9573c9e37fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:14.814361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390a90-88d5-4b1b-932e-9573c9e37fd3 None admin] PATH_INFO: `/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/2181bb81957a46e6ae1fccf0b32e66fe/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:14.816342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390a90-88d5-4b1b-932e-9573c9e37fd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=53e2ae4f4589424abfc724399c55ab86, user_id=2181bb81957a46e6ae1fccf0b32e66fe, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:14.817842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390a90-88d5-4b1b-932e-9573c9e37fd3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:14.835051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 650/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Thu Jul 21 05:30:14 2022] PUT /identity/v3/projects/53e2ae4f4589424abfc724399c55ab86/users/2181bb81957a46e6ae1fccf0b32e66fe/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:30:16.828622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57b26-550a-4715-9878-47c59b5b03a4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:16.829166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57b26-550a-4715-9878-47c59b5b03a4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:16.829166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba57b26-550a-4715-9878-47c59b5b03a4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:16.830579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 624/1274] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:16.836937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:16.837670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:16.837890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:16.858602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:16.859785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:16.931261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 651/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:16.965439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57b26-550a-4715-9878-47c59b5b03a4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:17.073083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba57b26-550a-4715-9878-47c59b5b03a4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:17.090455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:17.110338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:17.111122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:17.111400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:17.111670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:17.122453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 05:30:17.130070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:17.131155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:17.132011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 625/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Thu Jul 21 05:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:17.137341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:17.236298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:17.258626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b4933-9a7b-47a3-9d8a-74761bcbfcf8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:17.296535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:17.297218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:17.297494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:17.297761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:17.298499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:17.298800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:17.300183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:17.308535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 652/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Thu Jul 21 05:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:17.314851 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:17.432677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717fa4e-51e8-4461-b9f6-19299fafd240 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:17.476948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:17.478132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:17.478550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:17.478962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:17.493510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:17.495015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:17.514724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:17.515731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:17.517407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:17.517407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:17.517407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:17.517407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:17.517407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 626/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:17.524755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:17.633209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0015c2-e2d7-4a33-8b53-216a31098d65 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:17.667842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:17.668514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:17.668797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:17.669064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:17.669768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:17.670175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:17.671910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:17.683596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 653/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:17.689729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:17.725671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:17.796359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d45e9-1f3e-4f9a-83a4-8fd6859441e0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:17.832439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:17.833268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:17.833550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:17.833821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:17.841571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:17.843017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 05:30:17.857228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:17.858394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:17.860224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 627/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:17.866581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:17.871104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:17.975440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e6be0-bcc3-4404-a9ce-0a3eb24d4424 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:18.014306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:18.014955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:18.015234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:18.015503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:18.016333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:18.016669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:18.018109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:18.034902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 654/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Thu Jul 21 05:30:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:18.041548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:18.152786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:18.163881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d34ad-74f9-436f-a244-59df9738b979 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:18.201948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:18.202600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:18.202937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:18.203161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:18.278404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:18.280504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:18.375498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:18.391753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 628/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Thu Jul 21 05:30:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 05:30:18.397866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:18.460179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:18.498894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6406644-34f4-44c1-83c4-a4bf653fdfc2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:18.534251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:18.534977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:18.535294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:18.535566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:18.546356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:18.547820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 05:30:18.565778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:18.566796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:18.568363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 05:30:18.568363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 05:30:18.568363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 05:30:18.568363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:18.568363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 655/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:18.575172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:18.676054 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd4ada-08ac-423e-b3db-d8f1f06e2d38 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:18.712736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:18.713417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:18.713699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:18.713972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:18.714687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:18.714989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:18.716359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:18.727660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 629/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Thu Jul 21 05:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:18.733368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:18.841432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f252d5a-9d93-4edb-ae8c-6ac75550fc7e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:18.855387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:18.886049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:18.886837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:18.887110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:18.887377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:18.894559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:18.896010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 05:30:18.910069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:18.911116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: ERROR keystone.server.flask.application Jul 21 05:30:18.912392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 656/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Thu Jul 21 05:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:18.917419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:18.967607 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:19.018773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e44ce-d898-4c2b-95d9-e58c49e72efe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:19.054044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:19.054687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:19.054966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:19.055235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:19.056011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:19.056319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:19.057773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebb3e7-d4a8-4e7d-8137-115c0ee3ccb8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:19.070297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 630/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Thu Jul 21 05:30:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:19.076537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:19.177221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444fbc-3d58-4102-a128-e50f2f5395d7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:19.216540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:19.217226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:19.217670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:19.217827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:19.218786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] RBAC: Adding query filter params (role.id=3ccbc80128f444d4a4e5f61e5b10a88f, scope.project.id=53e2ae4f4589424abfc724399c55ab86, user.id=2181bb81957a46e6ae1fccf0b32e66fe) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:19.219137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:19.220722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb7b07-3a6c-4317-b9fb-f7445c543a6f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:19.227072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 657/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Thu Jul 21 05:30:19 2022] GET /identity/v3/role_assignments?user.id=2181bb81957a46e6ae1fccf0b32e66fe&scope.project.id=53e2ae4f4589424abfc724399c55ab86&role.id=3ccbc80128f444d4a4e5f61e5b10a88f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:21.282465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d388b0-8a70-47b0-941c-5b8f36c36492 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:21.283029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d388b0-8a70-47b0-941c-5b8f36c36492 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:21.283029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d388b0-8a70-47b0-941c-5b8f36c36492 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:21.284395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 631/1288] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:21.290756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:21.291532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:21.291676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:21.318771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:21.319962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:21.351564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:21.399314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 658/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:21.422079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d388b0-8a70-47b0-941c-5b8f36c36492 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:21.526507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d388b0-8a70-47b0-941c-5b8f36c36492 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:21.542292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:21.571405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:21.572255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:21.572533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:21.572821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:21.573472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:21.574844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:21.586911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:21.588305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:21.589537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 632/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:30:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:21.595072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:21.714307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e4e7-ad3c-454c-b126-2b38001060e0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:21.747265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:21.747909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:21.748186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:21.748454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:21.749189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:21.749495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:21.750874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e61336-8a34-472c-b270-f1396bd4e7a8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:21.755516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 659/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jul 21 05:30:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:21.761455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:21.864580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161297ff-cce4-49ee-9eeb-253d6e7946e1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:21.899461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:21.900102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:21.900378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:21.900681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:21.901382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:21.901687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:21.903041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eede8f6-4e46-4b81-9c27-1581d7662005 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:21.907624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 633/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jul 21 05:30:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:30:23.920437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233fe3-6089-43ec-a157-5d21c520288e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:23.921332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233fe3-6089-43ec-a157-5d21c520288e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:23.921332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233fe3-6089-43ec-a157-5d21c520288e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:23.923525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 660/1293] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:23.929971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe168-3db3-47d5-a261-1e5be6f3cb58 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:23.930647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe168-3db3-47d5-a261-1e5be6f3cb58 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:23.930765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe168-3db3-47d5-a261-1e5be6f3cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:23.958070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-01cbe168-3db3-47d5-a261-1e5be6f3cb58 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:23.959258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-01cbe168-3db3-47d5-a261-1e5be6f3cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:23.990305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:24.032494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 634/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:24.056104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd233fe3-6089-43ec-a157-5d21c520288e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:24.093705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:24.166666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd233fe3-6089-43ec-a157-5d21c520288e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:24.202944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f5f7e-1c5b-42eb-bf61-8fb6bb0be6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:24.203697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f5f7e-1c5b-42eb-bf61-8fb6bb0be6f7 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:24.204121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f5f7e-1c5b-42eb-bf61-8fb6bb0be6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:24.204460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f5f7e-1c5b-42eb-bf61-8fb6bb0be6f7 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:24.205414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f5f7e-1c5b-42eb-bf61-8fb6bb0be6f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:24.207086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f5f7e-1c5b-42eb-bf61-8fb6bb0be6f7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:24.224687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 661/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Thu Jul 21 05:30:24 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:30:26.247264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd2a3-cbb7-4a21-a764-deb7371d7914 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:26.248153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd2a3-cbb7-4a21-a764-deb7371d7914 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:26.248153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fd2a3-cbb7-4a21-a764-deb7371d7914 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:26.250350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 635/1296] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:26.255804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:26.256226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:26.256315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:26.274731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:26.275917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:26.351899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 662/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:26.374742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fd2a3-cbb7-4a21-a764-deb7371d7914 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:26.477267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fd2a3-cbb7-4a21-a764-deb7371d7914 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:26.512883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:26.513606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:26.513888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:26.514149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:26.514801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:26.516165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:26.528341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:26.529510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:26.530839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 636/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:30:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:26.537675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:26.556464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:26.640502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d20d3-9c29-448b-8acb-e73e288983d2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:26.674505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:26.675196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:26.675481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:26.675768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:26.676440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:26.676771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:26.678174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:26.683238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 663/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jul 21 05:30:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:26.690229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:26.729508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:26.799022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9a53b-146f-4e3c-b44b-f8abd418811d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:26.840078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:26.840756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:26.841034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:26.841304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:26.842067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] RBAC: Adding query filter params (interface=public, service_id=682d791ebb71453a8b8255ffc7e139d4, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:26.842387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:26.843740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb59d9-8f45-459e-b94e-b964478a8454 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:26.848902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 637/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Thu Jul 21 05:30:26 2022] GET /identity/v3/endpoints?service_id=682d791ebb71453a8b8255ffc7e139d4&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:26.858165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:26.947261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:26.966761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b83cd-d146-4a1c-8570-42df661643e3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:27.001585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd7a70-3d20-42f0-b351-3dcf4132a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:27.002237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd7a70-3d20-42f0-b351-3dcf4132a962 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:27.002514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd7a70-3d20-42f0-b351-3dcf4132a962 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:27.002782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd7a70-3d20-42f0-b351-3dcf4132a962 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:27.003450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd7a70-3d20-42f0-b351-3dcf4132a962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:27.004851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd7a70-3d20-42f0-b351-3dcf4132a962 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:27.011608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 664/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Thu Jul 21 05:30:26 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:30:29.007797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab396d-27d3-458a-b91e-e4fb94a2370a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:29.008678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab396d-27d3-458a-b91e-e4fb94a2370a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:29.008678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab396d-27d3-458a-b91e-e4fb94a2370a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:29.010939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 638/1302] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:30:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:30:29.017235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:29.017963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:29.018152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:29.036190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:30:29.037413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:30:29.118454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 665/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:30:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 05:30:29.141762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab396d-27d3-458a-b91e-e4fb94a2370a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:29.247595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:29.256583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab396d-27d3-458a-b91e-e4fb94a2370a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:29.294129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:29.294941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:29.295218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:29.295496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:29.296155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:29.297567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 05:30:29.309870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 05:30:29.311370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 21 05:30:29.312227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 639/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Thu Jul 21 05:30:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 05:30:29.317802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:29.410280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:29.434721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6bf0e-8a17-4367-a12d-98a3c16618b3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:29.469604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:29.470264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:29.470547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:29.470823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:29.471530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:30:29.471860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:29.473362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331dfa6-47ff-42ac-9a9d-bc5c37ebaf20 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:29.478629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 666/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Thu Jul 21 05:30:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:30:29.485641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:30:29.595691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d266e4d-a987-4904-8ad9-228c5e44de71 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:30:29.638959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dd456-86f2-4426-b270-343095b6234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:30:29.639618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd456-86f2-4426-b270-343095b6234a None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:30:29.639893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd456-86f2-4426-b270-343095b6234a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:30:29.640166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd456-86f2-4426-b270-343095b6234a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:30:29.640941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd456-86f2-4426-b270-343095b6234a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:30:29.642307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd456-86f2-4426-b270-343095b6234a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:30:29.664522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 640/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Thu Jul 21 05:30:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:30:39.475432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=30 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:30:39.659913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:33.131195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d36b-0af4-4b2f-8110-ff5c326d0f15 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:33.132272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d36b-0af4-4b2f-8110-ff5c326d0f15 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:33.132822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d36b-0af4-4b2f-8110-ff5c326d0f15 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:33.134477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 667/1307] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:33.140621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a839a-8031-4e22-ab0d-f89dcf171d88 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:33.141546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a839a-8031-4e22-ab0d-f89dcf171d88 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:33.142026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a839a-8031-4e22-ab0d-f89dcf171d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:33.230352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0d1a839a-8031-4e22-ab0d-f89dcf171d88 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:33.231919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0d1a839a-8031-4e22-ab0d-f89dcf171d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:33.350868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 641/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:33.399961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0af30-fc46-47f8-9469-3db7f2adc868 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:33.400598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0af30-fc46-47f8-9469-3db7f2adc868 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:33.401094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0af30-fc46-47f8-9469-3db7f2adc868 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:33.403060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 668/1309] 10.222.0.18 () {54 vars in 965 bytes} [Thu Jul 21 05:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:33.412554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509006df-0f49-437c-9530-b428aef42875 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:33.412855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509006df-0f49-437c-9530-b428aef42875 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:33.413148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509006df-0f49-437c-9530-b428aef42875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:33.546107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-509006df-0f49-437c-9530-b428aef42875 None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:33.547530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-509006df-0f49-437c-9530-b428aef42875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:33.571029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:33.661347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0af30-fc46-47f8-9469-3db7f2adc868 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:33.663351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-80c0af30-fc46-47f8-9469-3db7f2adc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:33.668173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 642/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Thu Jul 21 05:31:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:33.888009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0af30-fc46-47f8-9469-3db7f2adc868 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:33.987823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:33.988393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:33.988699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:33.988969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:33.990623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:34.045875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:34.102102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:34.103728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed36c1-ce01-4d94-98b9-4db01b81fa26 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:34.122567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 669/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:31:36.475992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80711a68-2914-4c17-adec-a9787e10549d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:36.476542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80711a68-2914-4c17-adec-a9787e10549d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:36.476634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80711a68-2914-4c17-adec-a9787e10549d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:36.477964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 643/1312] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:36.483373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acafa6-fcaa-40b8-82f6-9f81cc50c203 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:36.483847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acafa6-fcaa-40b8-82f6-9f81cc50c203 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:36.483929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acafa6-fcaa-40b8-82f6-9f81cc50c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:36.553771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f2acafa6-fcaa-40b8-82f6-9f81cc50c203 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:36.555002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f2acafa6-fcaa-40b8-82f6-9f81cc50c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:36.658450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 670/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:36.711563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e0a78-5b64-49fd-9db5-d750605e811c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:36.711843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e0a78-5b64-49fd-9db5-d750605e811c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:36.712260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e0a78-5b64-49fd-9db5-d750605e811c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:36.713787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 644/1314] 10.222.0.18 () {54 vars in 965 bytes} [Thu Jul 21 05:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:36.720114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a285c-0fed-43a9-8757-41076cf6b227 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:36.720450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a285c-0fed-43a9-8757-41076cf6b227 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:36.720757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a285c-0fed-43a9-8757-41076cf6b227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:36.731608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:36.802036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a53a285c-0fed-43a9-8757-41076cf6b227 None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:36.803251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a53a285c-0fed-43a9-8757-41076cf6b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:36.887797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 671/1315] 10.222.0.18 () {58 vars in 1062 bytes} [Thu Jul 21 05:31:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:36.897306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e0a78-5b64-49fd-9db5-d750605e811c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:36.898865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b35e0a78-5b64-49fd-9db5-d750605e811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:37.011389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e0a78-5b64-49fd-9db5-d750605e811c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:37.086389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:37.089765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:37.090435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:37.090723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:37.091004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:37.093268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:37.212052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:37.213565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2f92b-ed92-485a-8b09-b9f0a6f8e4fc service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:37.233207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 645/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:39.754206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d3b7-a298-46c9-81b9-1f45d2dbdec7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:39.755100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d3b7-a298-46c9-81b9-1f45d2dbdec7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:39.755100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d3b7-a298-46c9-81b9-1f45d2dbdec7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:39.757365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 672/1317] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:39.763741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719141-9ed1-4f34-9bb3-96ed3933fde8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:39.764431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719141-9ed1-4f34-9bb3-96ed3933fde8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:39.764761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7719141-9ed1-4f34-9bb3-96ed3933fde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:39.840305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d7719141-9ed1-4f34-9bb3-96ed3933fde8 None None] MFA Rules not processed for user `900cdf48c6ec493f841a7267e181fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:39.841566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d7719141-9ed1-4f34-9bb3-96ed3933fde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:39.894944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:39.943662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 646/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:39.993638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d3b7-a298-46c9-81b9-1f45d2dbdec7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:39.996006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dc96d3b7-a298-46c9-81b9-1f45d2dbdec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:40.111912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d3b7-a298-46c9-81b9-1f45d2dbdec7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:40.114871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:40.194456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:40.195273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:40.195547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:40.195846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:40.198500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:40.309718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:40.311145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69742de8-8d27-47e6-b5f2-d7de816e2670 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:40.330498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 673/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:42.927537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12268d-e553-4bd5-a8dc-75f441b7fb32 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:42.928403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12268d-e553-4bd5-a8dc-75f441b7fb32 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:42.928403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12268d-e553-4bd5-a8dc-75f441b7fb32 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:42.930619 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 647/1320] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:42.938800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad5be8-05c9-4d79-8313-36a38e43a647 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:42.939203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad5be8-05c9-4d79-8313-36a38e43a647 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:42.939349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad5be8-05c9-4d79-8313-36a38e43a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:42.978791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:43.004756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9dad5be8-05c9-4d79-8313-36a38e43a647 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:43.005953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9dad5be8-05c9-4d79-8313-36a38e43a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:43.104704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 674/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:43.143283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12268d-e553-4bd5-a8dc-75f441b7fb32 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:43.144836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3b12268d-e553-4bd5-a8dc-75f441b7fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:43.252722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12268d-e553-4bd5-a8dc-75f441b7fb32 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:43.337783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:43.338438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:43.338718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:43.338988 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:43.340738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:43.348299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:43.462681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:43.464155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26193-13e6-4512-bc60-76689edf6898 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:43.482499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 648/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:46.405196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da6c5f-a264-4ef1-b4f0-c12dd9fbfb50 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:46.405827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da6c5f-a264-4ef1-b4f0-c12dd9fbfb50 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:46.405827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da6c5f-a264-4ef1-b4f0-c12dd9fbfb50 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:46.410552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 675/1323] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:46.418987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa78694-39a3-4f58-bd7d-f8ba01e9d94b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:46.419481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa78694-39a3-4f58-bd7d-f8ba01e9d94b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:46.419666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa78694-39a3-4f58-bd7d-f8ba01e9d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:46.499540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4fa78694-39a3-4f58-bd7d-f8ba01e9d94b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:46.501327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4fa78694-39a3-4f58-bd7d-f8ba01e9d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:46.565001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:46.608630 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 649/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:46.645640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da6c5f-a264-4ef1-b4f0-c12dd9fbfb50 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:46.647244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-26da6c5f-a264-4ef1-b4f0-c12dd9fbfb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:46.763045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da6c5f-a264-4ef1-b4f0-c12dd9fbfb50 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:46.778885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:46.850625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:46.851271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:46.851550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:46.851816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:46.853548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:46.964271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:46.965651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef5da3-5beb-4bb8-86f5-b9fa884183f9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:46.984860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 676/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:49.042486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd634-a17a-4d1e-b251-eaf4ff7e337a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:49.043056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd634-a17a-4d1e-b251-eaf4ff7e337a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:49.043056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd634-a17a-4d1e-b251-eaf4ff7e337a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:49.044598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 650/1326] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:49.049764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e399-4620-4c02-8d50-976b78de5888 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:49.050241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e399-4620-4c02-8d50-976b78de5888 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:49.050341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e399-4620-4c02-8d50-976b78de5888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:49.101156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:49.119489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7b12e399-4620-4c02-8d50-976b78de5888 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:49.120739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7b12e399-4620-4c02-8d50-976b78de5888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:49.220190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 677/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:49.256051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd634-a17a-4d1e-b251-eaf4ff7e337a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:49.257953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4adbd634-a17a-4d1e-b251-eaf4ff7e337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:49.369398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd634-a17a-4d1e-b251-eaf4ff7e337a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:49.457308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:49.458024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:49.458262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:49.458566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:49.460231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:49.478378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:49.574544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:49.576007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57a05a-554e-4efe-b1c7-ef3f8b3382cc service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:49.594608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 651/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:51.670218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf4e16-1499-46f6-bbf0-7cdf74f591be None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:51.670905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf4e16-1499-46f6-bbf0-7cdf74f591be None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:51.670905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf4e16-1499-46f6-bbf0-7cdf74f591be None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:51.672173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 678/1329] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:51.677652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b601e-c66d-4efd-acf5-787ef17d0ba7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:51.678123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b601e-c66d-4efd-acf5-787ef17d0ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:51.678219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b601e-c66d-4efd-acf5-787ef17d0ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:51.748055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0e8b601e-c66d-4efd-acf5-787ef17d0ba7 None None] MFA Rules not processed for user `900cdf48c6ec493f841a7267e181fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:51.749394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0e8b601e-c66d-4efd-acf5-787ef17d0ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:51.818891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:51.852908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 652/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:51.894964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf4e16-1499-46f6-bbf0-7cdf74f591be None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:51.896522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-70bf4e16-1499-46f6-bbf0-7cdf74f591be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:52.005178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf4e16-1499-46f6-bbf0-7cdf74f591be None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:52.027717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:52.083804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:52.084505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:52.084783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:52.085054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:52.086699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:52.216443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:52.218908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27c419-7c4b-4357-85d9-a884bf8b816a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:52.240829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 679/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:54.499875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc4af-c45d-4098-9321-c0a60e9847c5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:54.500820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc4af-c45d-4098-9321-c0a60e9847c5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:54.500820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafc4af-c45d-4098-9321-c0a60e9847c5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:54.503017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 653/1332] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:54.508524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff898-b509-4802-b193-946c5510c711 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:54.508967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff898-b509-4802-b193-946c5510c711 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:54.509078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ff898-b509-4802-b193-946c5510c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:54.572963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:54.576134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8e5ff898-b509-4802-b193-946c5510c711 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:54.578155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8e5ff898-b509-4802-b193-946c5510c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:54.677918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 680/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:54.718699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafc4af-c45d-4098-9321-c0a60e9847c5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:54.721209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0bafc4af-c45d-4098-9321-c0a60e9847c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:54.842407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafc4af-c45d-4098-9321-c0a60e9847c5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:54.917949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:54.918622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:54.918872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:54.919154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:54.920854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:54.949122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:55.038519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:55.039958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bef42c-3c46-4d31-a5a2-ea3b5d3a621c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:55.058453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 654/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:31:57.107101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0f93-1047-48b3-804a-ea35b41aacec None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:57.107712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0f93-1047-48b3-804a-ea35b41aacec None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:57.107712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad0f93-1047-48b3-804a-ea35b41aacec None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:57.109110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 681/1335] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:31:57.115566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebd7d0-8645-462c-bc3c-dba0ea5d5a4a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:57.116300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebd7d0-8645-462c-bc3c-dba0ea5d5a4a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:57.116422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebd7d0-8645-462c-bc3c-dba0ea5d5a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:57.185701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-28ebd7d0-8645-462c-bc3c-dba0ea5d5a4a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:31:57.186958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-28ebd7d0-8645-462c-bc3c-dba0ea5d5a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:57.271606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:57.295729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 655/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:31:57.335791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad0f93-1047-48b3-804a-ea35b41aacec None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:31:57.337492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e2ad0f93-1047-48b3-804a-ea35b41aacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:57.455581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad0f93-1047-48b3-804a-ea35b41aacec None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:31:57.487758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:31:57.549375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:31:57.550031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:31:57.550311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:31:57.550582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:31:57.552256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:31:57.667330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:31:57.668802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6df4a-54d7-4920-bbe1-93ec97454feb service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:31:57.688810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 682/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:00.120513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c49f5-261a-4e38-adfd-8035faa81743 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:00.121103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c49f5-261a-4e38-adfd-8035faa81743 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:00.121103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c49f5-261a-4e38-adfd-8035faa81743 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:00.122470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 656/1338] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:00.129020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1e6dd-7fc4-4326-b2af-297a0f88235a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:00.129755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1e6dd-7fc4-4326-b2af-297a0f88235a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:00.129902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1e6dd-7fc4-4326-b2af-297a0f88235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:00.212940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c8a1e6dd-7fc4-4326-b2af-297a0f88235a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:00.214717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c8a1e6dd-7fc4-4326-b2af-297a0f88235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:00.224566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:00.319044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 683/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:00.364182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c49f5-261a-4e38-adfd-8035faa81743 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:00.365736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-996c49f5-261a-4e38-adfd-8035faa81743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:00.474577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c49f5-261a-4e38-adfd-8035faa81743 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:00.556245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:00.556931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:00.557211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:00.557477 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:00.559104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:00.594626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:00.671704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:00.673162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec610b0-63ab-4cc9-a9c1-e49b2697221a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:00.695939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 657/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:04.765495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40279-1252-4586-82cc-6add87e6521e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:04.766054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40279-1252-4586-82cc-6add87e6521e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:04.766054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40279-1252-4586-82cc-6add87e6521e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:04.767384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 684/1341] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:04.772979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020453-da43-4736-be92-e2e0413d016b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:04.773412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020453-da43-4736-be92-e2e0413d016b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:04.773535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020453-da43-4736-be92-e2e0413d016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:04.840297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-70020453-da43-4736-be92-e2e0413d016b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:04.841434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70020453-da43-4736-be92-e2e0413d016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:04.929203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:04.942807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 658/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:04.981847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd40279-1252-4586-82cc-6add87e6521e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:04.983535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9dd40279-1252-4586-82cc-6add87e6521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:05.092419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd40279-1252-4586-82cc-6add87e6521e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:05.129904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:05.166732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:05.167387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:05.167664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:05.167933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:05.169633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:05.280829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:05.282270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a35536-c4f1-4139-8459-a2ba3a334ca9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:05.301585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 685/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:07.878661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce77f9-b7d2-47f5-8aa4-fb9cce1b3bbe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.879225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce77f9-b7d2-47f5-8aa4-fb9cce1b3bbe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.879225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce77f9-b7d2-47f5-8aa4-fb9cce1b3bbe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.880684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 659/1344] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:07.886501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63971-f5ae-4ec9-8116-0b8445402f31 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:07.887061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63971-f5ae-4ec9-8116-0b8445402f31 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:07.887061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63971-f5ae-4ec9-8116-0b8445402f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:07.957478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a1e63971-f5ae-4ec9-8116-0b8445402f31 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:07.958670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a1e63971-f5ae-4ec9-8116-0b8445402f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:07.977671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:08.057963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 686/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:08.095621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce77f9-b7d2-47f5-8aa4-fb9cce1b3bbe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:08.097196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bfce77f9-b7d2-47f5-8aa4-fb9cce1b3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:08.208128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce77f9-b7d2-47f5-8aa4-fb9cce1b3bbe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:08.287789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:08.288447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:08.288757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:08.289032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:08.290669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:08.334333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:08.400992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:08.402441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617146fc-2738-4a6a-8544-65771c722c16 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:08.427628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 660/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:12.456093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4120-bd58-4484-ab90-955d92bbccdb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:12.456702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4120-bd58-4484-ab90-955d92bbccdb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:12.456702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4120-bd58-4484-ab90-955d92bbccdb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:12.458048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 687/1347] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:12.463337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2992ca-8beb-491a-9c36-2f9fb2c59af7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:12.463813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2992ca-8beb-491a-9c36-2f9fb2c59af7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:12.463895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2992ca-8beb-491a-9c36-2f9fb2c59af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:12.530708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4c2992ca-8beb-491a-9c36-2f9fb2c59af7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:12.531880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4c2992ca-8beb-491a-9c36-2f9fb2c59af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:12.656595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:12.660635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 661/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:12.699237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4120-bd58-4484-ab90-955d92bbccdb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:12.701051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bb1a4120-bd58-4484-ab90-955d92bbccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:12.809376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4120-bd58-4484-ab90-955d92bbccdb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:12.857464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:12.884565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:12.885227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:12.885510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:12.885783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:12.887479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:13.002136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:13.003607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ec7a3-9760-4c90-9967-69d8669def74 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:13.026586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 688/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:17.934182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef133ae-df69-4af1-acc9-df52e86abe18 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:17.934778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef133ae-df69-4af1-acc9-df52e86abe18 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:17.934778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef133ae-df69-4af1-acc9-df52e86abe18 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:17.936160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 662/1350] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:17.941648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9b1-34a4-46de-9bbe-778355817d0c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:17.942437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9b1-34a4-46de-9bbe-778355817d0c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:17.942896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9b1-34a4-46de-9bbe-778355817d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:18.023662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d128e9b1-34a4-46de-9bbe-778355817d0c None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:18.025257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d128e9b1-34a4-46de-9bbe-778355817d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:18.049300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:18.166252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 689/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:32:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:22.077446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6d329-6388-4ac3-a214-27d7d1f470d0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:22.078027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6d329-6388-4ac3-a214-27d7d1f470d0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:22.078027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6d329-6388-4ac3-a214-27d7d1f470d0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:22.079547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 663/1352] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:22.085557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce3fc3-5bb6-477d-8083-9016190960fc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:22.085989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce3fc3-5bb6-477d-8083-9016190960fc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:22.086101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce3fc3-5bb6-477d-8083-9016190960fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:22.161229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4ce3fc3-5bb6-477d-8083-9016190960fc None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:22.162415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4ce3fc3-5bb6-477d-8083-9016190960fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:22.243555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:22.276753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 690/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:32:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:32:23.723944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fedda-9f3d-48c0-a6c0-99bac11904f0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:23.724543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fedda-9f3d-48c0-a6c0-99bac11904f0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:23.724543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fedda-9f3d-48c0-a6c0-99bac11904f0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:23.725893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 664/1354] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:23.731277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd773913-8335-4438-9830-f7419fea9bc0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:23.731681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd773913-8335-4438-9830-f7419fea9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:23.732034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd773913-8335-4438-9830-f7419fea9bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:23.810588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cd773913-8335-4438-9830-f7419fea9bc0 None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:23.811795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cd773913-8335-4438-9830-f7419fea9bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:23.922291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 691/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:32:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:27.342036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6dde8-4504-4cfb-8a54-4b0600d3e982 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:27.342595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6dde8-4504-4cfb-8a54-4b0600d3e982 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:27.343571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6dde8-4504-4cfb-8a54-4b0600d3e982 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:27.347115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 665/1356] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:27.351369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb399-998b-4bc1-ad93-d3333df6478f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:27.351822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb399-998b-4bc1-ad93-d3333df6478f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:27.351919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb399-998b-4bc1-ad93-d3333df6478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:27.405974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:27.447260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-43cbb399-998b-4bc1-ad93-d3333df6478f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:27.448689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-43cbb399-998b-4bc1-ad93-d3333df6478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:27.552524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 692/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:27.608971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a660eb2-2c3b-4b3b-85b3-dabb0769b19e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:27.609257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a660eb2-2c3b-4b3b-85b3-dabb0769b19e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:27.609821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a660eb2-2c3b-4b3b-85b3-dabb0769b19e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:27.611836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 666/1358] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jul 21 05:32:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:27.620520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6905d99-ff98-4d7e-a593-034e47171e1a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:27.621022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6905d99-ff98-4d7e-a593-034e47171e1a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:27.621494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6905d99-ff98-4d7e-a593-034e47171e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:27.703315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b6905d99-ff98-4d7e-a593-034e47171e1a None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:27.704647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6905d99-ff98-4d7e-a593-034e47171e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:27.758458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:27.855506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 693/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jul 21 05:32:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:27.865569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a660eb2-2c3b-4b3b-85b3-dabb0769b19e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:27.867136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a660eb2-2c3b-4b3b-85b3-dabb0769b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:28.019692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a660eb2-2c3b-4b3b-85b3-dabb0769b19e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:28.097378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:28.141933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:28.142615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:28.142872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:28.143152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:28.145911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:28.269014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:28.270618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b6498-532d-4390-8f4b-bfd63e9ebeca service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:28.290098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 667/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:30.530538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0f70-44a4-4613-a4c3-ff612c811c0b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:30.531035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0f70-44a4-4613-a4c3-ff612c811c0b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:30.531035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0f70-44a4-4613-a4c3-ff612c811c0b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:30.532640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 694/1361] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:30.538448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5944aa-f464-467d-9d7a-85dfc227f592 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:30.539555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5944aa-f464-467d-9d7a-85dfc227f592 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:30.540052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5944aa-f464-467d-9d7a-85dfc227f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:30.609290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0d5944aa-f464-467d-9d7a-85dfc227f592 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:30.611160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0d5944aa-f464-467d-9d7a-85dfc227f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:30.654682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:30.737211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 668/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:30.787982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db0f70-44a4-4613-a4c3-ff612c811c0b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:30.789606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f8db0f70-44a4-4613-a4c3-ff612c811c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:30.989664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db0f70-44a4-4613-a4c3-ff612c811c0b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:31.000075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:31.118057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:31.118720 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:31.119000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:31.119293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:31.120973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:31.225999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:31.227541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499ae77-a708-4e58-a2e1-386b9bd4fc32 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:31.249479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 695/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:33.731260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afd699-3b3c-4f9f-894c-b7bccc721115 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:33.731811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afd699-3b3c-4f9f-894c-b7bccc721115 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:33.731811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afd699-3b3c-4f9f-894c-b7bccc721115 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:33.733786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 669/1364] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:33.739494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94b2db-7cb5-4563-930e-c615a3799cdd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:33.739967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94b2db-7cb5-4563-930e-c615a3799cdd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:33.740064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94b2db-7cb5-4563-930e-c615a3799cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:33.757275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:33.850614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1a94b2db-7cb5-4563-930e-c615a3799cdd None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:33.851193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1a94b2db-7cb5-4563-930e-c615a3799cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:33.999549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 696/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:34.053103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804df00-c8c8-473a-8cc3-8c0930dba0c6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:34.053387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804df00-c8c8-473a-8cc3-8c0930dba0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:34.053893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804df00-c8c8-473a-8cc3-8c0930dba0c6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:34.055365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 670/1366] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jul 21 05:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:34.063327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a4bb-44d1-4dfc-9319-ed779006306c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:34.063740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a4bb-44d1-4dfc-9319-ed779006306c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:34.064245 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a4bb-44d1-4dfc-9319-ed779006306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:34.187469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8b17a4bb-44d1-4dfc-9319-ed779006306c None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:34.189160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8b17a4bb-44d1-4dfc-9319-ed779006306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:34.234143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:34.342885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 697/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jul 21 05:32:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:34.351816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804df00-c8c8-473a-8cc3-8c0930dba0c6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:34.353370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0804df00-c8c8-473a-8cc3-8c0930dba0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:34.541456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804df00-c8c8-473a-8cc3-8c0930dba0c6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:34.565834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:34.686362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:34.686950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:34.687229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:34.687498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:34.690346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:34.796950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:34.798799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48ee06-13ae-419d-afa9-17b265c67c72 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:34.823558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 671/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:35.969693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c163a5e-10bc-40a5-81c6-2123e06cd8d6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:35.970210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c163a5e-10bc-40a5-81c6-2123e06cd8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:35.970210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c163a5e-10bc-40a5-81c6-2123e06cd8d6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:35.972028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 698/1369] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:35.977580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946b7c-de52-49fc-a563-d74007fe3a67 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:35.978031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946b7c-de52-49fc-a563-d74007fe3a67 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:35.978321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946b7c-de52-49fc-a563-d74007fe3a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:36.015941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:36.053724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e1946b7c-de52-49fc-a563-d74007fe3a67 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:36.055296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e1946b7c-de52-49fc-a563-d74007fe3a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:36.176756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 672/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:36.532563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f300d-4c9b-46ec-9e5d-87f6f48d5c11 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:36.532563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f300d-4c9b-46ec-9e5d-87f6f48d5c11 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:36.534729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f300d-4c9b-46ec-9e5d-87f6f48d5c11 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:36.534729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 699/1371] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jul 21 05:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:36.540996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80535e-2302-454a-bb15-d93ab9bf24ee None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:36.541547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80535e-2302-454a-bb15-d93ab9bf24ee None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:36.542031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80535e-2302-454a-bb15-d93ab9bf24ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:36.630411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ed80535e-2302-454a-bb15-d93ab9bf24ee None None] MFA Rules not processed for user `535729140fea45e99aa556d85913ae08`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:36.631893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ed80535e-2302-454a-bb15-d93ab9bf24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:36.687625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:36.728063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 673/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jul 21 05:32:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:36.740464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f300d-4c9b-46ec-9e5d-87f6f48d5c11 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:36.742130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6d7f300d-4c9b-46ec-9e5d-87f6f48d5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:36.915707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f300d-4c9b-46ec-9e5d-87f6f48d5c11 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:36.960325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:36.996460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:36.997314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:36.997692 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:36.998062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:36.999941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:37.006926 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739c788-b350-4d4c-8b4f-47fc9d77d9f3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:37.007392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739c788-b350-4d4c-8b4f-47fc9d77d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:37.007479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739c788-b350-4d4c-8b4f-47fc9d77d9f3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:37.012853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 674/1373] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:37.014012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9bb4-73ff-4afd-b6c0-eee34e7b9ad7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:37.014300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9bb4-73ff-4afd-b6c0-eee34e7b9ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:37.014608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b9bb4-73ff-4afd-b6c0-eee34e7b9ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:37.116893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eb9b9bb4-73ff-4afd-b6c0-eee34e7b9ad7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:37.118099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eb9b9bb4-73ff-4afd-b6c0-eee34e7b9ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:37.155063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:37.157102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:37.183625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 700/1374] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:37.269068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 675/1375] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:37.314046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:37.316458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:37.429840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:37.500697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d33b7-1d94-4854-bf29-a144630ab7b6 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:37.685583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:37.686554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:37.686836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:37.687105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:37.689029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:37.788566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:37.802798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:37.804427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0190ea-e241-40e2-b981-319523e56037 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:37.836661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 701/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:32:39.870714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c063d9-e89a-4730-a7ae-f5585cb4fb4f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.871241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c063d9-e89a-4730-a7ae-f5585cb4fb4f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.871241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c063d9-e89a-4730-a7ae-f5585cb4fb4f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.872576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 676/1377] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:39.877746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8acf1a-e1f6-4881-a153-5f4f50361607 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:39.878171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8acf1a-e1f6-4881-a153-5f4f50361607 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:39.878360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8acf1a-e1f6-4881-a153-5f4f50361607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:39.944735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4a8acf1a-e1f6-4881-a153-5f4f50361607 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:39.945935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a8acf1a-e1f6-4881-a153-5f4f50361607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:40.048108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 702/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:40.096029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c063d9-e89a-4730-a7ae-f5585cb4fb4f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:40.097581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-16c063d9-e89a-4730-a7ae-f5585cb4fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:40.171590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:40.293260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c063d9-e89a-4730-a7ae-f5585cb4fb4f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:40.411511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:40.412176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:40.412436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:40.412756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:40.414387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:40.429294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:40.516605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:40.518416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4daf1-9a42-4bf8-8430-284818a7bb57 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:40.537847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 677/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:42.607753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88144-299d-4758-9f92-198b6f3120a1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:42.608345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88144-299d-4758-9f92-198b6f3120a1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:42.608345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88144-299d-4758-9f92-198b6f3120a1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:42.609877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 703/1380] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:42.615209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc6e0-22ec-460c-bfaf-ad601903709c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:42.615767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc6e0-22ec-460c-bfaf-ad601903709c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:42.615767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc6e0-22ec-460c-bfaf-ad601903709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:42.685073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d6fcc6e0-22ec-460c-bfaf-ad601903709c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:42.686255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d6fcc6e0-22ec-460c-bfaf-ad601903709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:42.785071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:42.799405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 678/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:42.844017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88144-299d-4758-9f92-198b6f3120a1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:42.845576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a9d88144-299d-4758-9f92-198b6f3120a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:42.909994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:42.995628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88144-299d-4758-9f92-198b6f3120a1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:43.118456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:43.119236 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:43.119580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:43.119915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:43.121718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:43.144631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:43.217013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:43.218768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de646c7-633e-4652-a095-ce94e1ca84e6 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:43.237852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 704/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:45.295327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ff81-99c3-47a7-9bcc-839fda0c3ef9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:45.295927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ff81-99c3-47a7-9bcc-839fda0c3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:45.295927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ff81-99c3-47a7-9bcc-839fda0c3ef9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:45.297599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 679/1383] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:45.303652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95331623-5960-407a-8174-8005e3ed452b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:45.304339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95331623-5960-407a-8174-8005e3ed452b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:45.304339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95331623-5960-407a-8174-8005e3ed452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:45.378361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-95331623-5960-407a-8174-8005e3ed452b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:45.380063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95331623-5960-407a-8174-8005e3ed452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:45.496748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:45.501151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 705/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:45.547496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ff81-99c3-47a7-9bcc-839fda0c3ef9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:45.549204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-daa8ff81-99c3-47a7-9bcc-839fda0c3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:45.708350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ff81-99c3-47a7-9bcc-839fda0c3ef9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:45.793166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:45.848854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:45.849540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:45.849819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:45.850119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:45.851817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:45.964120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:45.965772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d6f1f-06bb-4db5-adee-784d906dcf0f service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:45.985519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 680/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:48.035782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9989c-c87d-41b8-b626-c5f51fd26e95 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.036409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9989c-c87d-41b8-b626-c5f51fd26e95 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.036409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9989c-c87d-41b8-b626-c5f51fd26e95 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.038126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 706/1386] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:32:48.043597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9b443-61bd-40ce-9894-e036d9ab4028 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.044045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9b443-61bd-40ce-9894-e036d9ab4028 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.044142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9b443-61bd-40ce-9894-e036d9ab4028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.111129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ebd9b443-61bd-40ce-9894-e036d9ab4028 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:48.112386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ebd9b443-61bd-40ce-9894-e036d9ab4028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:48.140306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:48.217347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 681/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:48.262529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9989c-c87d-41b8-b626-c5f51fd26e95 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:48.264166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-44c9989c-c87d-41b8-b626-c5f51fd26e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:48.415187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9989c-c87d-41b8-b626-c5f51fd26e95 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:48.500317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:48.548809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:48.549500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:48.549784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:48.550068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:48.552120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:48.668625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:48.671801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fbcb2-0e36-46f4-9f94-3b08e6c54015 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:48.696701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 707/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:50.792836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94a928-573a-4494-9b4d-84ce5bd340b0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:50.793424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94a928-573a-4494-9b4d-84ce5bd340b0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:50.793424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94a928-573a-4494-9b4d-84ce5bd340b0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:50.794750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 682/1389] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:50.800090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954276-75e0-40c3-818c-26e31f1e748b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:50.800564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954276-75e0-40c3-818c-26e31f1e748b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:50.800669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e954276-75e0-40c3-818c-26e31f1e748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:50.865002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8e954276-75e0-40c3-818c-26e31f1e748b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:50.866206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8e954276-75e0-40c3-818c-26e31f1e748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:50.900218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:50.964449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 708/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:51.008261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94a928-573a-4494-9b4d-84ce5bd340b0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:51.009819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fc94a928-573a-4494-9b4d-84ce5bd340b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:51.159388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94a928-573a-4494-9b4d-84ce5bd340b0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:51.168854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:51.278123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:51.278785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:51.279069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:51.279341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:51.281021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:51.375425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:51.377083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538c362-173f-415b-81f7-b12f3560949a service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:51.397699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 683/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:52.226332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799b8e2-b56b-4f31-98be-346b7497f165 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:52.226903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799b8e2-b56b-4f31-98be-346b7497f165 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:52.226903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799b8e2-b56b-4f31-98be-346b7497f165 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:52.228343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 709/1392] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:52.233818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8b57-b100-460f-a6f1-3fade390748d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:52.234298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8b57-b100-460f-a6f1-3fade390748d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:52.234395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8b57-b100-460f-a6f1-3fade390748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:52.248978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:52.299609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-febd8b57-b100-460f-a6f1-3fade390748d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:52.300848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-febd8b57-b100-460f-a6f1-3fade390748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:52.400770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 684/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:52.456595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f345-ce31-4ba5-81d1-01d57f8b9290 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:52.456886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f345-ce31-4ba5-81d1-01d57f8b9290 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:52.457158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645f345-ce31-4ba5-81d1-01d57f8b9290 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:52.458529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 710/1394] 10.222.0.18 () {54 vars in 966 bytes} [Thu Jul 21 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:52.463780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94191eb-16ea-4c9f-9a84-5e1ec736c322 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:52.464119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94191eb-16ea-4c9f-9a84-5e1ec736c322 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:52.464396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94191eb-16ea-4c9f-9a84-5e1ec736c322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:52.543041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c94191eb-16ea-4c9f-9a84-5e1ec736c322 None None] MFA Rules not processed for user `876f25e90653467bb67a7f406cc9a8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:52.544240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c94191eb-16ea-4c9f-9a84-5e1ec736c322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:52.584650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:52.629390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 685/1395] 10.222.0.18 () {58 vars in 1063 bytes} [Thu Jul 21 05:32:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:52.637096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645f345-ce31-4ba5-81d1-01d57f8b9290 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:52.638631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a645f345-ce31-4ba5-81d1-01d57f8b9290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:52.746403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645f345-ce31-4ba5-81d1-01d57f8b9290 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:52.810429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:52.823000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:52.823652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:52.823929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:52.824202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:52.825919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:52.934693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:52.936201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dfcf1-10ef-456c-841f-3350b5ffc184 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:52.955255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 711/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:53.477587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67e89-2a15-418a-933c-c654df548729 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:53.478155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67e89-2a15-418a-933c-c654df548729 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:53.478155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67e89-2a15-418a-933c-c654df548729 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:53.479587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 686/1397] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:53.485025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:53.485476 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:53.485570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:53.559467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:53.560742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:53.607973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:53.672284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 712/1398] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:53.677446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de9e6e-b304-428e-90dc-57f3bb01a0fd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:53.677812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de9e6e-b304-428e-90dc-57f3bb01a0fd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:53.678094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de9e6e-b304-428e-90dc-57f3bb01a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:53.719722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:53.720941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:53.753958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c2de9e6e-b304-428e-90dc-57f3bb01a0fd None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:53.755161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c2de9e6e-b304-428e-90dc-57f3bb01a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:53.836361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5215b-eb3d-4906-ba87-c0d5a548f004 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:53.841522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 687/1399] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:53.885323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e798-576b-4bc5-84c5-8a558f885ece None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:53.885692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e798-576b-4bc5-84c5-8a558f885ece None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:53.886036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e798-576b-4bc5-84c5-8a558f885ece None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:53.887534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 688/1400] 10.222.0.18 () {54 vars in 943 bytes} [Thu Jul 21 05:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:53.893586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf226-d3eb-4ec2-8642-f7d33f7ea89e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:53.893940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf226-d3eb-4ec2-8642-f7d33f7ea89e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:53.894279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf226-d3eb-4ec2-8642-f7d33f7ea89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:53.896904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:53.950786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:53.953024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:53.953813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:53.954094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:53.954404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:53.956507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:53.969791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cbfbf226-d3eb-4ec2-8642-f7d33f7ea89e None None] MFA Rules not processed for user `c18feb5be4814673933b8e140a91b2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:53.970960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cbfbf226-d3eb-4ec2-8642-f7d33f7ea89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:54.045719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:54.047320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:54.066660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 713/1401] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:54.078875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 689/1402] 10.222.0.18 () {58 vars in 1040 bytes} [Thu Jul 21 05:32:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:54.089219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:54.090441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:54.156687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:54.184456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020afb-9921-43fe-90a0-314743e92bd1 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:54.298075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:54.298736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:54.299013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:54.299404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:54.301502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:54.384281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:54.386020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4a2f0-dab6-4455-8a93-ea3d1868ee29 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:54.394192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 714/1403] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:32:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:32:56.144881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560f3c4-938d-4ad3-8126-7a03c42b39fe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:56.145546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560f3c4-938d-4ad3-8126-7a03c42b39fe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:56.145546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560f3c4-938d-4ad3-8126-7a03c42b39fe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:56.146813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 690/1404] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:56.152111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b602-eab3-4a63-9159-acc6b7e0f321 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:56.152583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b602-eab3-4a63-9159-acc6b7e0f321 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:56.152687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b602-eab3-4a63-9159-acc6b7e0f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:56.167677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:56.224073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2ee6b602-eab3-4a63-9159-acc6b7e0f321 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:56.225305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ee6b602-eab3-4a63-9159-acc6b7e0f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:56.328750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 715/1405] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:32:56.373909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560f3c4-938d-4ad3-8126-7a03c42b39fe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:56.375551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8560f3c4-938d-4ad3-8126-7a03c42b39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:56.496941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:56.542621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560f3c4-938d-4ad3-8126-7a03c42b39fe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:56.665092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:56.665757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:56.666038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:56.666377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:56.668861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:56.745819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:56.765889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:56.768001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bab13-8b89-4a81-bce3-c9bbc65ba25c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:56.788052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 691/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:32:58.870642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a4c36-7994-4046-991b-1f2c5fdbc696 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:58.871189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a4c36-7994-4046-991b-1f2c5fdbc696 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:58.871189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a4c36-7994-4046-991b-1f2c5fdbc696 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:58.876324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 716/1407] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:32:58.877940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddedd57-615a-40ee-a276-90d8cf3cf55b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:58.878392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddedd57-615a-40ee-a276-90d8cf3cf55b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:58.878499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddedd57-615a-40ee-a276-90d8cf3cf55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:58.945602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eddedd57-615a-40ee-a276-90d8cf3cf55b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:32:58.946818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eddedd57-615a-40ee-a276-90d8cf3cf55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:59.060730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 692/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:32:59.108835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a4c36-7994-4046-991b-1f2c5fdbc696 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:32:59.110687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-328a4c36-7994-4046-991b-1f2c5fdbc696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:59.219684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:59.325114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a4c36-7994-4046-991b-1f2c5fdbc696 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:32:59.478736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:32:59.479316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:32:59.479587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:32:59.479851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:32:59.481533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:32:59.544224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:32:59.585261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:32:59.587075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237f828-33ed-4fcb-8d45-bfa20237b540 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:32:59.608935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 717/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:09.057618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=79 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:09.606536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=21 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:16.360301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844c26-ac01-4857-b4d7-e7a9cf9cb02c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:16.360902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844c26-ac01-4857-b4d7-e7a9cf9cb02c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:16.360902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844c26-ac01-4857-b4d7-e7a9cf9cb02c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:16.362316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 693/1410] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jul 21 05:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:16.367626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cefe1-22fe-4328-9c27-f0de6bb46a17 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:16.368115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cefe1-22fe-4328-9c27-f0de6bb46a17 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:16.368214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cefe1-22fe-4328-9c27-f0de6bb46a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:16.443646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c82cefe1-22fe-4328-9c27-f0de6bb46a17 None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:16.444911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c82cefe1-22fe-4328-9c27-f0de6bb46a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:16.576141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 718/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jul 21 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:16.590937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6974f2-a723-46a2-8537-5275395e19f6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:16.591222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6974f2-a723-46a2-8537-5275395e19f6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:16.591501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6974f2-a723-46a2-8537-5275395e19f6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:16.592929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 694/1412] 10.222.0.18 () {54 vars in 918 bytes} [Thu Jul 21 05:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:16.597665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad144c-a0fe-4c60-8790-82bcf87937b7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:16.597960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad144c-a0fe-4c60-8790-82bcf87937b7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:16.598287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad144c-a0fe-4c60-8790-82bcf87937b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:16.672240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:16.675404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-46ad144c-a0fe-4c60-8790-82bcf87937b7 None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:16.677420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-46ad144c-a0fe-4c60-8790-82bcf87937b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:16.804782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 719/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jul 21 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:19.321626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b01d0e-4f15-43bb-89ef-801f060a096b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:19.322084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b01d0e-4f15-43bb-89ef-801f060a096b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:19.322193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b01d0e-4f15-43bb-89ef-801f060a096b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:19.323733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:19.329563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89d855-9e1c-4230-87b2-00709849bea4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:19.330016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89d855-9e1c-4230-87b2-00709849bea4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:19.330113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89d855-9e1c-4230-87b2-00709849bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:19.395440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3f89d855-9e1c-4230-87b2-00709849bea4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:19.396699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3f89d855-9e1c-4230-87b2-00709849bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:19.456984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:19.502550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:19.549791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b01d0e-4f15-43bb-89ef-801f060a096b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:19.551313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-63b01d0e-4f15-43bb-89ef-801f060a096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:19.720063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b01d0e-4f15-43bb-89ef-801f060a096b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:19.800437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:19.844192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:19.845019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:19.845308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:19.845574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:19.847273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:19.957690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:19.959307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992535e-3e9a-4b4d-9bec-b2aae7fd3a61 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:19.977873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 696/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:20.884214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079526c-9158-426f-8566-03031599b363 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:20.884856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079526c-9158-426f-8566-03031599b363 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:20.884856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079526c-9158-426f-8566-03031599b363 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:20.886259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:20.891596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d15b-4514-4031-8386-b7e40364cf71 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:20.892046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d15b-4514-4031-8386-b7e40364cf71 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:20.892184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d15b-4514-4031-8386-b7e40364cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:20.970109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e915d15b-4514-4031-8386-b7e40364cf71 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:20.971323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e915d15b-4514-4031-8386-b7e40364cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:21.001794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:21.079875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:21.232105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079526c-9158-426f-8566-03031599b363 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:21.233589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0079526c-9158-426f-8566-03031599b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:21.399152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079526c-9158-426f-8566-03031599b363 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:21.446314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:21.524532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:21.525109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:21.525386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:21.525659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:21.527306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:21.629796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:21.631451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82d2f8-8256-4b49-98ed-312e2ca062cc service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:21.654306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 722/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:22.545802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9d5a7-3994-44df-9989-d111875a139c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:22.546640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9d5a7-3994-44df-9989-d111875a139c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:22.546640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9d5a7-3994-44df-9989-d111875a139c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:22.549032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:22.557581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30b59c-c1e1-4375-a901-a5d736b19b8e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:22.557986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30b59c-c1e1-4375-a901-a5d736b19b8e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:22.558148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30b59c-c1e1-4375-a901-a5d736b19b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:22.735185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:22.756830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1a30b59c-c1e1-4375-a901-a5d736b19b8e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:22.758070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1a30b59c-c1e1-4375-a901-a5d736b19b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:22.856969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:23.008507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9d5a7-3994-44df-9989-d111875a139c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:23.010667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-43f9d5a7-3994-44df-9989-d111875a139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:23.169166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9d5a7-3994-44df-9989-d111875a139c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:23.181552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:23.287348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:23.287924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:23.288202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:23.288488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:23.290162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:23.386705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:23.388317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497fa7b-8ed9-468f-8857-71446982f9d7 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:23.407813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 699/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:24.254523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eae97-401a-4135-a64e-b252be340c32 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:24.255093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eae97-401a-4135-a64e-b252be340c32 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:24.255093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eae97-401a-4135-a64e-b252be340c32 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:24.256412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:24.262541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a0235-996f-45fc-b85f-357148d826c5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:24.262989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a0235-996f-45fc-b85f-357148d826c5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:24.263102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a0235-996f-45fc-b85f-357148d826c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:24.293428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:24.354057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ec3a0235-996f-45fc-b85f-357148d826c5 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:24.355992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec3a0235-996f-45fc-b85f-357148d826c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:24.458231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:24.611109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eae97-401a-4135-a64e-b252be340c32 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:24.613649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-191eae97-401a-4135-a64e-b252be340c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:24.736446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:24.778637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eae97-401a-4135-a64e-b252be340c32 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:24.905405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:24.905978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:24.906254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:24.906519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:24.908162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:24.993654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:25.008389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:25.010007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeda72-c9de-4ff5-8bdb-4f6e08f2fc79 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:25.027442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 725/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:25.896167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224f8a4-9f8c-4b4f-9bb6-fa87bd48c20c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:25.896794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224f8a4-9f8c-4b4f-9bb6-fa87bd48c20c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:25.896794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224f8a4-9f8c-4b4f-9bb6-fa87bd48c20c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:25.898144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:25.904258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724448-fb6e-40bf-9494-39d33c66c6af None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:25.905035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724448-fb6e-40bf-9494-39d33c66c6af None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:25.905228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724448-fb6e-40bf-9494-39d33c66c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:25.993301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c0724448-fb6e-40bf-9494-39d33c66c6af None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:25.994515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c0724448-fb6e-40bf-9494-39d33c66c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:26.099277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:26.252246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224f8a4-9f8c-4b4f-9bb6-fa87bd48c20c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:26.254406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2224f8a4-9f8c-4b4f-9bb6-fa87bd48c20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:26.345863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:26.411460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224f8a4-9f8c-4b4f-9bb6-fa87bd48c20c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:26.562278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:26.562942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:26.563221 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:26.563499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:26.565184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:26.618007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:26.660388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:26.662175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e7a22-a830-467c-91d5-c1ec81457449 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:26.681076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 702/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:27.485826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f371d-0ddc-4fb9-99fe-0c9a61050c7b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:27.486403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f371d-0ddc-4fb9-99fe-0c9a61050c7b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:27.486403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f371d-0ddc-4fb9-99fe-0c9a61050c7b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:27.487833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:27.493935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e212f-fbb1-4fa9-8dce-f0bad9c7f2b6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:27.494633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e212f-fbb1-4fa9-8dce-f0bad9c7f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:27.494742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e212f-fbb1-4fa9-8dce-f0bad9c7f2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:27.570227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8a7e212f-fbb1-4fa9-8dce-f0bad9c7f2b6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:27.571430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8a7e212f-fbb1-4fa9-8dce-f0bad9c7f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:27.673381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:27.825382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f371d-0ddc-4fb9-99fe-0c9a61050c7b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:27.826947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1e3f371d-0ddc-4fb9-99fe-0c9a61050c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:27.881232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:27.989360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f371d-0ddc-4fb9-99fe-0c9a61050c7b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:28.111059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:28.111711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:28.111989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:28.112262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:28.113937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:28.121161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:28.216237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:28.217886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173396f-c45d-4b3e-baac-04e89a2a7a74 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:28.237553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 728/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:29.044597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b0dbe-12ff-4174-868e-86c1ae260ff4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:29.045195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b0dbe-12ff-4174-868e-86c1ae260ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:29.045195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b0dbe-12ff-4174-868e-86c1ae260ff4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:29.046503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:29.055234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee476-3686-426f-a715-7e6a63997a3f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:29.056052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee476-3686-426f-a715-7e6a63997a3f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:29.056225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee476-3686-426f-a715-7e6a63997a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:29.141577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-df8ee476-3686-426f-a715-7e6a63997a3f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:29.142802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-df8ee476-3686-426f-a715-7e6a63997a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:29.216034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:29.246689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:29.399395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b0dbe-12ff-4174-868e-86c1ae260ff4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:29.401887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e28b0dbe-12ff-4174-868e-86c1ae260ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:29.426342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:29.560077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b0dbe-12ff-4174-868e-86c1ae260ff4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:29.655426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:29.683955 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:29.684654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:29.684938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:29.685212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:29.686920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:29.780447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:29.782103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e55e-24bd-4a36-a491-fbea47cf36b1 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:29.801513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 705/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:30.621682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc3a2c-093a-4f4f-a263-0b01ed90737a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:30.622542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc3a2c-093a-4f4f-a263-0b01ed90737a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:30.622542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc3a2c-093a-4f4f-a263-0b01ed90737a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:30.624767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:30.633018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac2f6-9927-4257-b2b0-83cad097d22c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:30.633471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac2f6-9927-4257-b2b0-83cad097d22c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:30.633608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac2f6-9927-4257-b2b0-83cad097d22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:30.716023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-80cac2f6-9927-4257-b2b0-83cad097d22c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:30.717171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80cac2f6-9927-4257-b2b0-83cad097d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:30.759084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:30.814227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:30.974314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc3a2c-093a-4f4f-a263-0b01ed90737a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:30.976928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eabc3a2c-093a-4f4f-a263-0b01ed90737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:31.130876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc3a2c-093a-4f4f-a263-0b01ed90737a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:31.194906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:31.257147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:31.257713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:31.257985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:31.258248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:31.259898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:31.350608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:31.352204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a6004-053b-45df-b0df-703a7213212a service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:31.370343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 731/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:32.172436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95863e-108b-4c74-a538-3cc922b955e7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:32.173363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95863e-108b-4c74-a538-3cc922b955e7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:32.173363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95863e-108b-4c74-a538-3cc922b955e7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:32.176020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:33:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:32.181189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b9ce-f096-41c1-9906-3dbf8c329161 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:32.181667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b9ce-f096-41c1-9906-3dbf8c329161 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:32.181771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b9ce-f096-41c1-9906-3dbf8c329161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:32.262238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9fc3b9ce-f096-41c1-9906-3dbf8c329161 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:32.263527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9fc3b9ce-f096-41c1-9906-3dbf8c329161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:32.265619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:32.366020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:32.525028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95863e-108b-4c74-a538-3cc922b955e7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:32.527543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dc95863e-108b-4c74-a538-3cc922b955e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:32.692401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95863e-108b-4c74-a538-3cc922b955e7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:32.720881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:32.810272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:32.810932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:32.811208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:32.811485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:32.813170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:32.911601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:32.913267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3609382-6c87-43a7-9523-ed2c76c7604c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:32.932122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 708/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:34.876646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30196963-f90b-4288-9f24-aa3f30831504 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:34.877217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30196963-f90b-4288-9f24-aa3f30831504 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:34.877217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30196963-f90b-4288-9f24-aa3f30831504 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:34.878582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:34.885024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78bab-cc8b-4be6-a001-51c4ddabe859 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:34.885498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78bab-cc8b-4be6-a001-51c4ddabe859 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:34.885605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78bab-cc8b-4be6-a001-51c4ddabe859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:34.932320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:34.958411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-29f78bab-cc8b-4be6-a001-51c4ddabe859 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:34.959623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-29f78bab-cc8b-4be6-a001-51c4ddabe859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:35.074324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:35.115033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30196963-f90b-4288-9f24-aa3f30831504 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:35.116622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-30196963-f90b-4288-9f24-aa3f30831504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:35.223521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30196963-f90b-4288-9f24-aa3f30831504 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:35.254549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:35.297081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:35.297737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:35.298016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:35.298285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:35.300308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:35.419702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:35.421234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded3c30-c99e-43af-9a41-ab8221a981da service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:35.440086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 734/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:37.613100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff71fd-027f-4015-abce-ccf98eebd46a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:37.613935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff71fd-027f-4015-abce-ccf98eebd46a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:37.614092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff71fd-027f-4015-abce-ccf98eebd46a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:37.616311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:37.625392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459aebc-23be-40dc-b52f-27f1f6e038dd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:37.626123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459aebc-23be-40dc-b52f-27f1f6e038dd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:37.626332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459aebc-23be-40dc-b52f-27f1f6e038dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:37.701775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a459aebc-23be-40dc-b52f-27f1f6e038dd None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:37.703117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a459aebc-23be-40dc-b52f-27f1f6e038dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:37.716116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:37.821340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:37.864180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff71fd-027f-4015-abce-ccf98eebd46a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:37.864180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-94ff71fd-027f-4015-abce-ccf98eebd46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:37.977652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff71fd-027f-4015-abce-ccf98eebd46a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:37.991617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:38.055457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:38.056118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:38.056401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:38.056737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:38.058408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:38.175097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:38.176464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84471df-184b-4be0-a451-5da39910ccd8 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:38.195726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 711/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:40.501622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477315-c3e0-47a4-9d5f-a5928bc9f37b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:40.502451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477315-c3e0-47a4-9d5f-a5928bc9f37b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:40.502620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477315-c3e0-47a4-9d5f-a5928bc9f37b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:40.504833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:40.511281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2bc3f-4bc4-4802-a5d4-32246af57a7c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:40.512026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2bc3f-4bc4-4802-a5d4-32246af57a7c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:40.512148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2bc3f-4bc4-4802-a5d4-32246af57a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:40.561511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:40.579609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-59a2bc3f-4bc4-4802-a5d4-32246af57a7c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:40.580831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-59a2bc3f-4bc4-4802-a5d4-32246af57a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:40.684713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:40.726141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477315-c3e0-47a4-9d5f-a5928bc9f37b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:40.728126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b2477315-c3e0-47a4-9d5f-a5928bc9f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:40.843294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477315-c3e0-47a4-9d5f-a5928bc9f37b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:40.885679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:40.922353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:40.923008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:40.923834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:40.924113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:40.926159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:41.045539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:41.046998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2e00-7e93-4d99-b8c7-9181a541fa5b service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:41.068117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 737/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:43.210306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079aa2-fb4d-464d-b2e6-455aff69abad None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:43.211205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079aa2-fb4d-464d-b2e6-455aff69abad None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:43.211205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d079aa2-fb4d-464d-b2e6-455aff69abad None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:43.213557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:43.221303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a239c-1ee5-487f-bf03-905accfadf14 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:43.221761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a239c-1ee5-487f-bf03-905accfadf14 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:43.221955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a239c-1ee5-487f-bf03-905accfadf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:43.291379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-481a239c-1ee5-487f-bf03-905accfadf14 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:43.293317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-481a239c-1ee5-487f-bf03-905accfadf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:43.322223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:43.402828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:43.442043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d079aa2-fb4d-464d-b2e6-455aff69abad None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:43.443576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4d079aa2-fb4d-464d-b2e6-455aff69abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:43.551861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d079aa2-fb4d-464d-b2e6-455aff69abad None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:43.573729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:43.629885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:43.630527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:43.630809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:43.631077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:43.632748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:43.748219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:43.749740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99032ca-9ad3-4ead-adc3-23d387945795 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:43.769073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 714/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:45.853712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb069b9-62e5-4aab-8349-3fea8b372818 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:45.854611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb069b9-62e5-4aab-8349-3fea8b372818 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:45.854611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb069b9-62e5-4aab-8349-3fea8b372818 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:45.856872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:45.863183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc65ef-385f-497c-be45-6cfc1682c824 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:45.863620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc65ef-385f-497c-be45-6cfc1682c824 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:45.863725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc65ef-385f-497c-be45-6cfc1682c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:45.937367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:45.940660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b3bc65ef-385f-497c-be45-6cfc1682c824 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:45.942672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b3bc65ef-385f-497c-be45-6cfc1682c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:46.046783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:46.085642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb069b9-62e5-4aab-8349-3fea8b372818 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:46.087114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0bb069b9-62e5-4aab-8349-3fea8b372818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:46.207195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb069b9-62e5-4aab-8349-3fea8b372818 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:46.266679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:46.293662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:46.294311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:46.294592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:46.294864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:46.296510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:46.414302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:46.415790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bca38-be62-41a0-8d7e-3f9fe3bac771 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:46.436082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 740/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:33:48.482358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0719-d5f0-436d-9316-61ff71aaa061 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:48.483225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0719-d5f0-436d-9316-61ff71aaa061 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:48.483225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0719-d5f0-436d-9316-61ff71aaa061 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:48.485514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:48.493557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa5cab-080f-4b21-ac53-831de69083da None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:48.494053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa5cab-080f-4b21-ac53-831de69083da None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:48.494053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa5cab-080f-4b21-ac53-831de69083da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:48.560221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5baa5cab-080f-4b21-ac53-831de69083da None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:48.561429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5baa5cab-080f-4b21-ac53-831de69083da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:48.590937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:48.663653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:48.702902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c0719-d5f0-436d-9316-61ff71aaa061 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:48.704428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8c4c0719-d5f0-436d-9316-61ff71aaa061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:48.817109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c0719-d5f0-436d-9316-61ff71aaa061 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:48.846365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:48.905227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:48.905888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:48.906170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:48.906444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:48.908151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:49.021473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:49.022849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80829397-a24c-41f1-983d-820463d572f8 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:49.043033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 717/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:33:51.215336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa27b-d301-44d8-9a5f-9b3f710922a4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:51.215907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa27b-d301-44d8-9a5f-9b3f710922a4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:51.215907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa27b-d301-44d8-9a5f-9b3f710922a4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:51.218125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:51.226144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a423-f037-4c13-ac36-98034e27de8d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:51.226597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a423-f037-4c13-ac36-98034e27de8d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:51.226707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a423-f037-4c13-ac36-98034e27de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:51.292427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2351a423-f037-4c13-ac36-98034e27de8d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:51.293672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2351a423-f037-4c13-ac36-98034e27de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:51.303443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:51.398080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:51.439254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fa27b-d301-44d8-9a5f-9b3f710922a4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:51.440845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8d9fa27b-d301-44d8-9a5f-9b3f710922a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:51.552836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fa27b-d301-44d8-9a5f-9b3f710922a4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:51.610342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:51.630669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:51.631332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:51.631616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:51.631891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:51.633610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:51.745671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:51.747120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede399d-597e-48f5-90cc-dc849bccabdd service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:51.766583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 743/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:53.832118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff752-5de2-42b9-9510-400331081173 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:53.832710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff752-5de2-42b9-9510-400331081173 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:53.832710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff752-5de2-42b9-9510-400331081173 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:53.834121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:53.840982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1f48-7185-4ab9-b763-dac1ac9c5ff4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:53.841756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1f48-7185-4ab9-b763-dac1ac9c5ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:53.841930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1f48-7185-4ab9-b763-dac1ac9c5ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:53.907945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d86a1f48-7185-4ab9-b763-dac1ac9c5ff4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:53.909176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d86a1f48-7185-4ab9-b763-dac1ac9c5ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:53.947677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:54.008203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:54.046550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bff752-5de2-42b9-9510-400331081173 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:54.048081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-29bff752-5de2-42b9-9510-400331081173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:54.153632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bff752-5de2-42b9-9510-400331081173 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:54.202576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:54.242041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:54.242699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:54.242984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:54.243257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:54.244944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:54.366006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:54.368188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1840e-2f8f-4d1c-afc1-eb158ff15929 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:54.390767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 720/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:56.416328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c9efe-c0a6-41b2-a09e-e0fca5a8dda6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:56.417260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c9efe-c0a6-41b2-a09e-e0fca5a8dda6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:56.417260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c9efe-c0a6-41b2-a09e-e0fca5a8dda6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:56.419311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:56.426493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a9ff-7e7f-498c-82b3-a2041476694b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:56.426859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a9ff-7e7f-498c-82b3-a2041476694b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:56.426859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0a9ff-7e7f-498c-82b3-a2041476694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:56.496217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aea0a9ff-7e7f-498c-82b3-a2041476694b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:56.497450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aea0a9ff-7e7f-498c-82b3-a2041476694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:56.516778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:56.598769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:56.639403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c9efe-c0a6-41b2-a09e-e0fca5a8dda6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:56.641955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-285c9efe-c0a6-41b2-a09e-e0fca5a8dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:56.765121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c9efe-c0a6-41b2-a09e-e0fca5a8dda6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:56.834946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:56.842306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:56.842967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:56.843254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:56.843566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:56.845295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:56.960096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:56.961598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9622-457d-41a8-94b5-99f3ac2ecd33 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:56.980615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 746/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:33:59.012379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3fb7-3a3e-4da3-b0e7-139d17f98304 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:59.012999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3fb7-3a3e-4da3-b0e7-139d17f98304 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:59.012999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3fb7-3a3e-4da3-b0e7-139d17f98304 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:59.015048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:33:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:33:59.024261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ff4a-f354-456c-9e98-aeb4da9e6ce8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:59.024702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ff4a-f354-456c-9e98-aeb4da9e6ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:59.024829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1ff4a-f354-456c-9e98-aeb4da9e6ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:59.095349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-76e1ff4a-f354-456c-9e98-aeb4da9e6ce8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:33:59.096611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-76e1ff4a-f354-456c-9e98-aeb4da9e6ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:59.147683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:59.197902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:33:59.234944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3fb7-3a3e-4da3-b0e7-139d17f98304 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:33:59.236629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-608a3fb7-3a3e-4da3-b0e7-139d17f98304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:59.351960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3fb7-3a3e-4da3-b0e7-139d17f98304 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:33:59.410767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:33:59.438688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:33:59.439351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:33:59.439632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:33:59.439904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:33:59.441589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:33:59.555114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:33:59.556609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a223ac5-2011-40c2-acbc-78cf94dd42f0 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:33:59.575028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 723/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:09.196068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=22 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:09.572625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=66 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:19.111722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68eca3-3901-43f0-b75b-26038cf4b456 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:19.112647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68eca3-3901-43f0-b75b-26038cf4b456 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:19.112647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68eca3-3901-43f0-b75b-26038cf4b456 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:19.114930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 748/1471] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:19.120362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e460-28cf-45aa-ba74-31ded93140a2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:19.120835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e460-28cf-45aa-ba74-31ded93140a2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:19.120932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07e460-28cf-45aa-ba74-31ded93140a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:19.195755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1d07e460-28cf-45aa-ba74-31ded93140a2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:19.197003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1d07e460-28cf-45aa-ba74-31ded93140a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:19.308240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 724/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:19.395750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb764-8d85-4f0b-a90e-079d3d59094c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:19.396030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb764-8d85-4f0b-a90e-079d3d59094c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:19.396298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb764-8d85-4f0b-a90e-079d3d59094c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:19.397691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 749/1473] 10.222.0.18 () {54 vars in 966 bytes} [Thu Jul 21 05:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:34:19.402760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b54fa-947b-4079-b995-00a10b856345 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:19.403052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b54fa-947b-4079-b995-00a10b856345 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:19.403335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b54fa-947b-4079-b995-00a10b856345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:19.483075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-395b54fa-947b-4079-b995-00a10b856345 None None] MFA Rules not processed for user `876f25e90653467bb67a7f406cc9a8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:19.484290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-395b54fa-947b-4079-b995-00a10b856345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:19.505328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:19.566520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 725/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Thu Jul 21 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:19.574230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acb764-8d85-4f0b-a90e-079d3d59094c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:19.575766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d7acb764-8d85-4f0b-a90e-079d3d59094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:19.698544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acb764-8d85-4f0b-a90e-079d3d59094c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:19.776096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:19.776773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:19.777047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:19.777323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:19.778974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:19.832912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:19.894928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:19.894928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904ddb1-065e-440b-9ac1-d268856ddc56 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:19.916171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 750/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:22.026795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175e6e-ed4d-4848-b9e8-177a08103765 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:22.027748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175e6e-ed4d-4848-b9e8-177a08103765 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:22.027748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175e6e-ed4d-4848-b9e8-177a08103765 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:22.030001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 726/1476] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:22.036642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d734d2-e9ec-4751-9f00-dc92bc0438c6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:22.037375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d734d2-e9ec-4751-9f00-dc92bc0438c6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:22.037547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d734d2-e9ec-4751-9f00-dc92bc0438c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:22.114161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4d734d2-e9ec-4751-9f00-dc92bc0438c6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:22.115362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4d734d2-e9ec-4751-9f00-dc92bc0438c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:22.217161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 751/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:22.241816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175e6e-ed4d-4848-b9e8-177a08103765 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:22.243406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3a175e6e-ed4d-4848-b9e8-177a08103765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:22.382335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175e6e-ed4d-4848-b9e8-177a08103765 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:22.437815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:22.486232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:22.486897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:22.487176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:22.487448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:22.488184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:22.490037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:34:22.490037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:34:22.490037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:34:22.491179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25683d8-fdac-49d4-824e-1eb324587614 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:22.510350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 727/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Thu Jul 21 05:34:22 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:34:24.575038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072344b9-fc9f-42f6-8ddf-c43ce6ce6752 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:24.575649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072344b9-fc9f-42f6-8ddf-c43ce6ce6752 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:24.575649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072344b9-fc9f-42f6-8ddf-c43ce6ce6752 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:24.576995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 752/1479] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:24.582505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75952e-4dc7-4ecd-90f7-98c434db4151 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:24.582931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75952e-4dc7-4ecd-90f7-98c434db4151 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:24.583024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75952e-4dc7-4ecd-90f7-98c434db4151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:24.657956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aa75952e-4dc7-4ecd-90f7-98c434db4151 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:24.659175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aa75952e-4dc7-4ecd-90f7-98c434db4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:24.763469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 728/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:24.824246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072344b9-fc9f-42f6-8ddf-c43ce6ce6752 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:24.825815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-072344b9-fc9f-42f6-8ddf-c43ce6ce6752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:24.836415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:25.001741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072344b9-fc9f-42f6-8ddf-c43ce6ce6752 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:25.087403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:25.126294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:25.127380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:25.127874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:25.128358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:25.130299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:25.224757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:25.226377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f88fa-5a9d-4842-acb2-db04478a4b15 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:25.245473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 753/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:27.430135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0087c4-277f-49fb-ba9d-b04678d9fffa None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:27.430675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0087c4-277f-49fb-ba9d-b04678d9fffa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:27.430675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0087c4-277f-49fb-ba9d-b04678d9fffa None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:27.432056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 729/1482] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:27.438344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793bea5-a429-498f-8a9c-338fda7b28c2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:27.438826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793bea5-a429-498f-8a9c-338fda7b28c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:27.439015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793bea5-a429-498f-8a9c-338fda7b28c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:27.507180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d793bea5-a429-498f-8a9c-338fda7b28c2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:27.508392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d793bea5-a429-498f-8a9c-338fda7b28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:27.558039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:27.621946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 754/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:27.658495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0087c4-277f-49fb-ba9d-b04678d9fffa None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:27.660038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4d0087c4-277f-49fb-ba9d-b04678d9fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:27.689579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:27.898651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0087c4-277f-49fb-ba9d-b04678d9fffa None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:27.974286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:27.974935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:27.975214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:27.975487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:27.977258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:28.053539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:28.095658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:28.097198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a850b06-f208-466c-9112-c9bc4a49276a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:28.116170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 730/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:30.167619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ffc6-7cf5-4a0b-a2f9-d393478e0a50 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:30.168171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ffc6-7cf5-4a0b-a2f9-d393478e0a50 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:30.168171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ffc6-7cf5-4a0b-a2f9-d393478e0a50 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:30.169565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 755/1485] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:30.175683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d6b3-689b-4898-96b5-4b92910d7d05 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:30.176429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d6b3-689b-4898-96b5-4b92910d7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:30.176429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d6b3-689b-4898-96b5-4b92910d7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:30.245433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0f95d6b3-689b-4898-96b5-4b92910d7d05 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:30.246573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0f95d6b3-689b-4898-96b5-4b92910d7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:30.348206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 731/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:30.386760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7ffc6-7cf5-4a0b-a2f9-d393478e0a50 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:30.388292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6a7ffc6-7cf5-4a0b-a2f9-d393478e0a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:30.494071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7ffc6-7cf5-4a0b-a2f9-d393478e0a50 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:30.565494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:30.567780 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:30.568664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:30.569118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:30.569554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:30.571226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:30.681099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:30.682574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519ce24-3fab-4075-83ef-335f8d20dddb service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:30.701952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 756/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:32.846888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6347-928f-439a-b291-772b071d5493 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:32.847434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6347-928f-439a-b291-772b071d5493 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:32.847434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6347-928f-439a-b291-772b071d5493 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:32.848963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 732/1488] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:32.854360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69860-cc18-4839-a831-ec3fb21ec76b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:32.854825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69860-cc18-4839-a831-ec3fb21ec76b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:32.854940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69860-cc18-4839-a831-ec3fb21ec76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:32.927371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0ad69860-cc18-4839-a831-ec3fb21ec76b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:32.928679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0ad69860-cc18-4839-a831-ec3fb21ec76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:32.983168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:33.032786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 757/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:33.073938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6347-928f-439a-b291-772b071d5493 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:33.075473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f28d6347-928f-439a-b291-772b071d5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:33.117478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:33.189162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6347-928f-439a-b291-772b071d5493 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:33.268734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:33.269393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:33.269669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:33.269936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:33.271594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:33.354063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:33.386682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:33.388109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be7c50-2f63-4f53-9a8d-ba26ea160b64 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:33.408703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 733/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:35.626532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5f13-4115-445a-84d5-a9be804697c2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:35.627114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5f13-4115-445a-84d5-a9be804697c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:35.627114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa5f13-4115-445a-84d5-a9be804697c2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:35.628789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 758/1491] 10.222.0.18 () {54 vars in 926 bytes} [Thu Jul 21 05:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:34:35.633889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a29a0-5d80-454d-b5cf-e9c16aec6989 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:35.634280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a29a0-5d80-454d-b5cf-e9c16aec6989 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:35.634442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a29a0-5d80-454d-b5cf-e9c16aec6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:35.710147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d94a29a0-5d80-454d-b5cf-e9c16aec6989 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:34:35.711393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d94a29a0-5d80-454d-b5cf-e9c16aec6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:35.808001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 734/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Thu Jul 21 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:34:35.847035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5f13-4115-445a-84d5-a9be804697c2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:34:35.848592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-12fa5f13-4115-445a-84d5-a9be804697c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:35.963699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa5f13-4115-445a-84d5-a9be804697c2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:34:36.035487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:34:36.036143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:34:36.036427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:34:36.036741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:34:36.038381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:34:36.047231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:36.148021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:34:36.149528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e00c4e-9d39-45e4-ae40-3df01840b3b2 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:34:36.167401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 759/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:34:45.806210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:34:46.165277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=50 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:02.058045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:02.058675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:02.058675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:02.151095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:36:02.153290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:02.268247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 735/1494] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:36:02.279950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:02.280514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:02.280514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:02.368156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:36:02.369333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:02.471514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 760/1495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:36:02.476423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:02.477712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:02.489371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75372e69-470e-4f19-aca5-c5ad7e317244 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:02.559852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:02.596257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:02.596919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:02.597203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:02.597497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:02.598214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:36:02.598487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:02.599556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:02.599556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:36:02.599556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:36:02.600435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:02.611742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 736/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:36:02.620414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:02.630092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe0873-ca2d-4bcc-b9b8-e115fc09350e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:02.701389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:02.735977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:02.736663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:02.736935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:02.737208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:02.737886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:02.739673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:02.739673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:36:02.739673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:36:02.740892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:02.797760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 761/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:36:02 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:36:02.802467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:02.804009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:02.836660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c438b-f6bb-4aec-8177-63226edf4b42 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:02.929327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:02.929935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:02.930214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:02.930477 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:02.931174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:02.932182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:02.932182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:36:02.932182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:36:02.933394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:02.982514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 737/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:36:02 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:36:02.987000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:02.988585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:03.049654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85d39-d62f-4a78-b6cc-8f4c1347711a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:03.147622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:03.159472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:03.160149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:03.160456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:03.160729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:03.161454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:03.162482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:03.162482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:36:03.162482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:36:03.163375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:03.176827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 762/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:36:03.180969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:03.182435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:03.194178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91a5e3-f4d2-4404-835b-0e525bb2605a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:03.220974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:03.293831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:03.294503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:03.294781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:03.295052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:03.295785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:03.296840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:03.296840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:36:03.296840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:36:03.297732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38558f-b840-4648-986a-6e2d90ca28bf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:03.310636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 738/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:36:03.316058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:03.317646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:03.351795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfbe04-685a-4e1e-84ff-0da744d5b0fa admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:03.450406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:03.451306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:03.451582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:03.451865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] PATH_INFO: `/v3/projects/454c19c12a624e499017ea858e15b3b4/users/2c588d9153074eaea8bd8bf99e4ec305/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:03.475842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=454c19c12a624e499017ea858e15b3b4, user_id=2c588d9153074eaea8bd8bf99e4ec305, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:03.476928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:03.476928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:36:03.476928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:36:03.478838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec518-0fa0-42ee-a021-f5c90d99bf8f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:03.507505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 763/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:36:03 2022] PUT /identity/v3/projects/454c19c12a624e499017ea858e15b3b4/users/2c588d9153074eaea8bd8bf99e4ec305/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:36:03.523018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732ffd-17b4-435d-9560-ab4a45e5ef7c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:03.523305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732ffd-17b4-435d-9560-ab4a45e5ef7c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:03.523584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732ffd-17b4-435d-9560-ab4a45e5ef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:03.586493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d0732ffd-17b4-435d-9560-ab4a45e5ef7c None None] MFA Rules not processed for user `2c588d9153074eaea8bd8bf99e4ec305`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:36:03.587725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d0732ffd-17b4-435d-9560-ab4a45e5ef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:03.668639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 739/1502] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:36:03.682951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bca1e-adcd-4d12-af17-e0ceaf0dcb3c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:03.683178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bca1e-adcd-4d12-af17-e0ceaf0dcb3c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:03.683448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bca1e-adcd-4d12-af17-e0ceaf0dcb3c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:03.684853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 764/1503] 10.222.0.18 () {54 vars in 964 bytes} [Thu Jul 21 05:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:36:03.689858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a071-9772-48b6-b517-b213304c9335 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:03.690140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a071-9772-48b6-b517-b213304c9335 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:03.690437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a071-9772-48b6-b517-b213304c9335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:03.722964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:03.769280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2161a071-9772-48b6-b517-b213304c9335 None None] MFA Rules not processed for user `535729140fea45e99aa556d85913ae08`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:36:03.770488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2161a071-9772-48b6-b517-b213304c9335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:03.847946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 740/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Thu Jul 21 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:36:03.856465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bca1e-adcd-4d12-af17-e0ceaf0dcb3c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:03.858584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ef1bca1e-adcd-4d12-af17-e0ceaf0dcb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:03.923073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:03.991788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bca1e-adcd-4d12-af17-e0ceaf0dcb3c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:04.066494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:04.067134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:04.067410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:04.067678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:04.069342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:04.177040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:04.178504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:04.182007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:04.199464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 765/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:36:04.243488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ad5f-4a16-4f11-b499-563a9e2ca749 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:04.243923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ad5f-4a16-4f11-b499-563a9e2ca749 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:04.244035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ad5f-4a16-4f11-b499-563a9e2ca749 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:04.245332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 741/1506] 10.222.0.18 () {52 vars in 829 bytes} [Thu Jul 21 05:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:36:04.249031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:04.250249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:04.351041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be480f-97e4-46ba-acd2-36fb3dd0c347 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:04.450472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:04.451361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:04.451635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:04.451903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] PATH_INFO: `/v3/users/2c588d9153074eaea8bd8bf99e4ec305` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:04.469914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c588d9153074eaea8bd8bf99e4ec305)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:04.470969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:04.470969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:36:04.470969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:36:04.472173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:04.483599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:04.540004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c588d9153074eaea8bd8bf99e4ec305'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:04.562239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c588d9153074eaea8bd8bf99e4ec305'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:04.562865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c588d9153074eaea8bd8bf99e4ec305'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:04.578316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c588d9153074eaea8bd8bf99e4ec305'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:04.590760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c588d9153074eaea8bd8bf99e4ec305'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:04.596786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 766/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:36:04 2022] DELETE /identity/v3/users/2c588d9153074eaea8bd8bf99e4ec305 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:36:04.601380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:04.601663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:04.601936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:04.658549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:36:04.659750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:04.735150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:04.749086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 742/1508] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:36:04.758924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:04.760194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:04.881337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0abe5c-35b5-4d1f-9bb7-11466eb96084 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:04.937088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:04.957374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:04.958020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:04.958297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:04.958566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:04.960206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:05.074088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:05.075523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fed38-c509-4249-a1f9-1662a2096437 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:05.095747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 767/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:36:05.443681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:36:05.445133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:36:05.457338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6be35-a51e-4cfe-868b-ca7603090a8c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:36:05.560271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:36:05.561184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:36:05.561465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:36:05.561737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] PATH_INFO: `/v3/projects/454c19c12a624e499017ea858e15b3b4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:36:05.573062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454c19c12a624e499017ea858e15b3b4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:36:05.574118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:05.574118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:36:05.574118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:36:05.575329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:36:05.638203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454c19c12a624e499017ea858e15b3b4', 'request_id': 'req-8aa11d95-73eb-4647-8648-c17576e4c113'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:05.650072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454c19c12a624e499017ea858e15b3b4', 'request_id': 'req-8aa11d95-73eb-4647-8648-c17576e4c113'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:05.665474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454c19c12a624e499017ea858e15b3b4', 'request_id': 'req-8aa11d95-73eb-4647-8648-c17576e4c113'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:05.689961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] The token cache is being invalidate because project 454c19c12a624e499017ea858e15b3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:36:05.690184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:05.690606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8aa11d95-73eb-4647-8648-c17576e4c113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:36:05.692119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 743/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:36:05 2022] DELETE /identity/v3/projects/454c19c12a624e499017ea858e15b3b4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:36:15.093156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=62 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:15.687594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:37:51.504971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee80c7-e8da-4757-aaec-65584244425b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:51.505470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee80c7-e8da-4757-aaec-65584244425b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:51.505470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee80c7-e8da-4757-aaec-65584244425b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:51.506920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:37:51.513081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01ce64-e5c3-4506-ad78-e5762bbd9b2e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:51.513568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01ce64-e5c3-4506-ad78-e5762bbd9b2e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:51.513679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01ce64-e5c3-4506-ad78-e5762bbd9b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:51.605589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2a01ce64-e5c3-4506-ad78-e5762bbd9b2e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:37:51.606936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2a01ce64-e5c3-4506-ad78-e5762bbd9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:51.722370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:37:51.886630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee80c7-e8da-4757-aaec-65584244425b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:37:51.889385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-57ee80c7-e8da-4757-aaec-65584244425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:52.026817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee80c7-e8da-4757-aaec-65584244425b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:37:52.033501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd86ec-54cd-4a9f-8abc-d71a9ff6e1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:37:52.034150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd86ec-54cd-4a9f-8abc-d71a9ff6e1bd service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:52.034435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd86ec-54cd-4a9f-8abc-d71a9ff6e1bd service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:52.034706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd86ec-54cd-4a9f-8abc-d71a9ff6e1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:52.043367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd86ec-54cd-4a9f-8abc-d71a9ff6e1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:37:52.045044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd86ec-54cd-4a9f-8abc-d71a9ff6e1bd service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:37:52.054930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 769/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:52.888666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f6ebd-4193-4844-85ca-edd9d1c6e2ae None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:52.889580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f6ebd-4193-4844-85ca-edd9d1c6e2ae None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:52.889580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f6ebd-4193-4844-85ca-edd9d1c6e2ae None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:52.891843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:37:52.898014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932de015-f49e-42dd-b5d3-80a948ff49c1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:52.898455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932de015-f49e-42dd-b5d3-80a948ff49c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:52.898575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932de015-f49e-42dd-b5d3-80a948ff49c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:52.926755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-932de015-f49e-42dd-b5d3-80a948ff49c1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:37:52.927961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-932de015-f49e-42dd-b5d3-80a948ff49c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:52.936913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:37:53.100159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f6ebd-4193-4844-85ca-edd9d1c6e2ae None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:37:53.117304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f6ebd-4193-4844-85ca-edd9d1c6e2ae None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:37:53.122891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eba65-e609-4c67-970b-fd1f38eb435d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:37:53.123544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eba65-e609-4c67-970b-fd1f38eb435d service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:53.123824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eba65-e609-4c67-970b-fd1f38eb435d service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:53.124094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eba65-e609-4c67-970b-fd1f38eb435d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:53.132253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eba65-e609-4c67-970b-fd1f38eb435d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:37:53.133909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eba65-e609-4c67-970b-fd1f38eb435d service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:37:53.143971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 746/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:53.499010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba00712-c296-437f-9702-b5300d42af95 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:53.499278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba00712-c296-437f-9702-b5300d42af95 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:53.499579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba00712-c296-437f-9702-b5300d42af95 None None] PATH_INFO: `/v3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:53.500941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 771/1517] 10.222.0.39 () {54 vars in 925 bytes} [Thu Jul 21 05:37:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:37:53.507495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb679b-f192-4da9-84ef-a1dbd13ac8bd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:53.507777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb679b-f192-4da9-84ef-a1dbd13ac8bd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:53.508053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb679b-f192-4da9-84ef-a1dbd13ac8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:53.575035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-10eb679b-f192-4da9-84ef-a1dbd13ac8bd None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:37:53.576251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-10eb679b-f192-4da9-84ef-a1dbd13ac8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:53.594622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:37:53.654745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 747/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jul 21 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:37:57.476948 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b22c-2401-435b-9d8b-6797ac48d94f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:57.477488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b22c-2401-435b-9d8b-6797ac48d94f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:57.477488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b22c-2401-435b-9d8b-6797ac48d94f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:57.478762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 772/1519] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jul 21 05:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:37:57.485006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b544ac-9a7b-4067-be0e-b791f0d409be None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:57.485456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b544ac-9a7b-4067-be0e-b791f0d409be None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:57.485565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b544ac-9a7b-4067-be0e-b791f0d409be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:57.509189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-01b544ac-9a7b-4067-be0e-b791f0d409be None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:37:57.510406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-01b544ac-9a7b-4067-be0e-b791f0d409be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:37:57.520423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 748/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jul 21 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:37:57.528429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b22c-2401-435b-9d8b-6797ac48d94f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:37:57.543699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b22c-2401-435b-9d8b-6797ac48d94f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:37:57.549689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129c4b1-d8d1-4eed-a317-64d0075e2c39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:37:57.550325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c4b1-d8d1-4eed-a317-64d0075e2c39 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:37:57.550603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c4b1-d8d1-4eed-a317-64d0075e2c39 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:37:57.550873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c4b1-d8d1-4eed-a317-64d0075e2c39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:37:57.559316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c4b1-d8d1-4eed-a317-64d0075e2c39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:37:57.560932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c4b1-d8d1-4eed-a317-64d0075e2c39 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:37:57.570509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 773/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:37:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:04.428864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf890c-37ef-4590-8620-2a83a71f517b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:04.429545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf890c-37ef-4590-8620-2a83a71f517b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:04.429658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf890c-37ef-4590-8620-2a83a71f517b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:04.431801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:38:04.437575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83277-083f-4c9b-b17a-73320eb8d1c8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:04.438292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83277-083f-4c9b-b17a-73320eb8d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:04.438434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf83277-083f-4c9b-b17a-73320eb8d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:04.463283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5bf83277-083f-4c9b-b17a-73320eb8d1c8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:38:04.464523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5bf83277-083f-4c9b-b17a-73320eb8d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:04.473020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:38:04.624220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf890c-37ef-4590-8620-2a83a71f517b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:38:04.645222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf890c-37ef-4590-8620-2a83a71f517b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:38:04.651711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dc25f-dac1-4208-b3d4-356cc73298f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:38:04.652354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dc25f-dac1-4208-b3d4-356cc73298f4 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:04.652682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dc25f-dac1-4208-b3d4-356cc73298f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:04.652952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dc25f-dac1-4208-b3d4-356cc73298f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:04.661011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dc25f-dac1-4208-b3d4-356cc73298f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:38:04.662600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dc25f-dac1-4208-b3d4-356cc73298f4 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:38:04.672355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 750/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:05.496313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb437a6-6def-4de9-9caa-3063ad2ced9a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:05.496870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb437a6-6def-4de9-9caa-3063ad2ced9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:05.496870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb437a6-6def-4de9-9caa-3063ad2ced9a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:05.498269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 05:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:38:05.504423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e20dbb-0e20-49e7-bd24-5545b8b5c28f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:05.504904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e20dbb-0e20-49e7-bd24-5545b8b5c28f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:05.505018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e20dbb-0e20-49e7-bd24-5545b8b5c28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:05.524241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-45e20dbb-0e20-49e7-bd24-5545b8b5c28f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:38:05.525487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-45e20dbb-0e20-49e7-bd24-5545b8b5c28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:05.534772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 05:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:38:05.692005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb437a6-6def-4de9-9caa-3063ad2ced9a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:38:05.714164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb437a6-6def-4de9-9caa-3063ad2ced9a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:38:05.721403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b5e6-9542-40fd-b8a5-42ff990f6f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:38:05.722045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5e6-9542-40fd-b8a5-42ff990f6f44 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:05.722354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5e6-9542-40fd-b8a5-42ff990f6f44 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:05.722628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5e6-9542-40fd-b8a5-42ff990f6f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:05.731063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b5e6-9542-40fd-b8a5-42ff990f6f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:38:05.732699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b5e6-9542-40fd-b8a5-42ff990f6f44 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:38:05.742209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 776/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:09.611029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763ccd-face-4e2e-af0e-1513c443eb8e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:09.611603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763ccd-face-4e2e-af0e-1513c443eb8e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:09.611603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24763ccd-face-4e2e-af0e-1513c443eb8e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:09.613038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:38:09.620514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa43be-16f2-479e-a30a-bc0b52b2d4a2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:09.620953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa43be-16f2-479e-a30a-bc0b52b2d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:09.621056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa43be-16f2-479e-a30a-bc0b52b2d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:09.641493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-06aa43be-16f2-479e-a30a-bc0b52b2d4a2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:38:09.642715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06aa43be-16f2-479e-a30a-bc0b52b2d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:09.651771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:38:09.726676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24763ccd-face-4e2e-af0e-1513c443eb8e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:38:09.729678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24763ccd-face-4e2e-af0e-1513c443eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:09.816338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24763ccd-face-4e2e-af0e-1513c443eb8e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:38:09.820289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e8dbc-f0e5-41f7-bfea-6cc19ad27324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:38:09.820970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e8dbc-f0e5-41f7-bfea-6cc19ad27324 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:09.821281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e8dbc-f0e5-41f7-bfea-6cc19ad27324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:09.821540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e8dbc-f0e5-41f7-bfea-6cc19ad27324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:09.831103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e8dbc-f0e5-41f7-bfea-6cc19ad27324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:38:09.832583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e8dbc-f0e5-41f7-bfea-6cc19ad27324 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:38:09.842157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 753/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:11.886008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d873d-ec3a-4716-b0a4-60ff4c018b5d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:11.886611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d873d-ec3a-4716-b0a4-60ff4c018b5d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:11.886611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d873d-ec3a-4716-b0a4-60ff4c018b5d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:11.887910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:38:11.893342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48028f4-851d-4867-a5a9-83e03fa9f24e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:11.893789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48028f4-851d-4867-a5a9-83e03fa9f24e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:11.893900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48028f4-851d-4867-a5a9-83e03fa9f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:11.913400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e48028f4-851d-4867-a5a9-83e03fa9f24e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:38:11.914583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e48028f4-851d-4867-a5a9-83e03fa9f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:11.926501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:38:11.975468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d873d-ec3a-4716-b0a4-60ff4c018b5d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:38:11.990116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d873d-ec3a-4716-b0a4-60ff4c018b5d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:38:11.994579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cf6fd-f3db-4e29-82ff-e92c868a9179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:38:11.995211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf6fd-f3db-4e29-82ff-e92c868a9179 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:11.995490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf6fd-f3db-4e29-82ff-e92c868a9179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:11.995752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cf6fd-f3db-4e29-82ff-e92c868a9179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:12.005228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cf6fd-f3db-4e29-82ff-e92c868a9179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:38:12.006686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cf6fd-f3db-4e29-82ff-e92c868a9179 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:38:12.016203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 779/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:15.589728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e34b8-2493-4c41-8511-d25cc174695f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:15.590322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e34b8-2493-4c41-8511-d25cc174695f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:15.590322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e34b8-2493-4c41-8511-d25cc174695f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:15.591637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:38:15.598055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db6a35-fec9-42a1-8859-e04a823ad7ff None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:15.598527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db6a35-fec9-42a1-8859-e04a823ad7ff None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:15.598643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db6a35-fec9-42a1-8859-e04a823ad7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:15.609276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:38:15.622797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-75db6a35-fec9-42a1-8859-e04a823ad7ff None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:38:15.624009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-75db6a35-fec9-42a1-8859-e04a823ad7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:15.633186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:38:15.939166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e34b8-2493-4c41-8511-d25cc174695f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:38:15.942083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bf5e34b8-2493-4c41-8511-d25cc174695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:16.013893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:38:16.028825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e34b8-2493-4c41-8511-d25cc174695f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:38:16.033155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f256-9150-44be-b19f-9676c0e23748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:38:16.033810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f256-9150-44be-b19f-9676c0e23748 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:16.034094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f256-9150-44be-b19f-9676c0e23748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:16.034370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f256-9150-44be-b19f-9676c0e23748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:16.043408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f256-9150-44be-b19f-9676c0e23748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:38:16.045248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f256-9150-44be-b19f-9676c0e23748 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:38:16.054581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 756/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:18.120678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80668-2db1-4b4b-a873-6ed92597877e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:18.121251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80668-2db1-4b4b-a873-6ed92597877e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:18.121251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a80668-2db1-4b4b-a873-6ed92597877e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:18.122520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 05:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:38:18.128969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520549b3-bd96-4771-9379-366fa5fc86fa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:18.129707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520549b3-bd96-4771-9379-366fa5fc86fa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:18.129877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520549b3-bd96-4771-9379-366fa5fc86fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:18.153533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-520549b3-bd96-4771-9379-366fa5fc86fa None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:38:18.154747 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-520549b3-bd96-4771-9379-366fa5fc86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:18.163938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:38:18.470848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80668-2db1-4b4b-a873-6ed92597877e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:38:18.473010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-83a80668-2db1-4b4b-a873-6ed92597877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:38:18.488676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a80668-2db1-4b4b-a873-6ed92597877e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:38:18.493457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24b0b-5da5-48c0-81be-002176976e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:38:18.494103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24b0b-5da5-48c0-81be-002176976e6d service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:38:18.494381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24b0b-5da5-48c0-81be-002176976e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:38:18.494652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24b0b-5da5-48c0-81be-002176976e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:38:18.504509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd24b0b-5da5-48c0-81be-002176976e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:38:18.505977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd24b0b-5da5-48c0-81be-002176976e6d service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:38:18.515926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 782/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:38:28.148945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=11 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:38:28.511568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:50.710409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.711769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.712319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.739304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:50.740546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:50.751500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 758/1540] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:39:50.761021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b5ec1-670f-46bd-b6d2-65c5e7d696d4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.761620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b5ec1-670f-46bd-b6d2-65c5e7d696d4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.761620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b5ec1-670f-46bd-b6d2-65c5e7d696d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.790054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f83b5ec1-670f-46bd-b6d2-65c5e7d696d4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:50.791637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f83b5ec1-670f-46bd-b6d2-65c5e7d696d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:50.807423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 783/1541] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:50.812257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:50.822710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec27162-84a6-4fca-b707-a049232cf07e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:50.833143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:50.834003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.834290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.834573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.835314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:50.835692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:50.837810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:50.847310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983080a2-4d26-4674-9530-eac58598f329 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.847654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983080a2-4d26-4674-9530-eac58598f329 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.847877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983080a2-4d26-4674-9530-eac58598f329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.859571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 759/1542] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:50.868190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:50.880186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-983080a2-4d26-4674-9530-eac58598f329 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:50.881433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-983080a2-4d26-4674-9530-eac58598f329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:50.889866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9c724-340c-408f-b2d9-7f148c48d6df admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:50.891735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 784/1543] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:50.900840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.901134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.901420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.902005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:50.902690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.903066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.903350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.904070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:50.908178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:39:50.908178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:39:50.908178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:39:50.909512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:50.932603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:50.933838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:50.953791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 785/1544] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:50.958145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:50.973569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a57b36-f00b-4706-887c-95c01731fb55 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:50.977541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 760/1545] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:50 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:39:50.981500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:50.984297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:50.985108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:50.985396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:50.985667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:50.986407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:50.986722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:50.987818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:39:50.987818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:39:50.987818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:39:50.988731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.012423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 786/1546] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:39:51.015798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.031176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4192a-228a-4706-815a-568226f59a02 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.077071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fde03-9850-4b20-a17b-4dcd38f7c614 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.095656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ede3c-f83c-46d5-a91c-d58dc68c8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.096358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ede3c-f83c-46d5-a91c-d58dc68c8c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.096665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ede3c-f83c-46d5-a91c-d58dc68c8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.096938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ede3c-f83c-46d5-a91c-d58dc68c8c11 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.097658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ede3c-f83c-46d5-a91c-d58dc68c8c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.100846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ede3c-f83c-46d5-a91c-d58dc68c8c11 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.129772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 761/1547] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:50 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:51.131632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce283-625e-4908-b6c5-49684ad3075a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.132157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce283-625e-4908-b6c5-49684ad3075a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.132731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce283-625e-4908-b6c5-49684ad3075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.137168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2ad16-0e12-447a-a1e9-df35a2020b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.137889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ad16-0e12-447a-a1e9-df35a2020b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.138171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ad16-0e12-447a-a1e9-df35a2020b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.138446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ad16-0e12-447a-a1e9-df35a2020b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.139148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ad16-0e12-447a-a1e9-df35a2020b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.141277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ad16-0e12-447a-a1e9-df35a2020b84 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.154053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d8cce283-625e-4908-b6c5-49684ad3075a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.155625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8cce283-625e-4908-b6c5-49684ad3075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.167826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 762/1548] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.169116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305da89-c880-41b2-aa6d-8c7dec6074c8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.169398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305da89-c880-41b2-aa6d-8c7dec6074c8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.169672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305da89-c880-41b2-aa6d-8c7dec6074c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.173642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 787/1549] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:39:51.175688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.176520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.177048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.192537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6305da89-c880-41b2-aa6d-8c7dec6074c8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.193803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6305da89-c880-41b2-aa6d-8c7dec6074c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.198895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.200081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.254821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 763/1550] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.256078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b34eff-31f7-4978-8dd3-0bd7d51ac4d6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.256303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b34eff-31f7-4978-8dd3-0bd7d51ac4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.256595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b34eff-31f7-4978-8dd3-0bd7d51ac4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.258248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 788/1551] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.259225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.269470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686d42-3ae0-4515-ad8d-9b378667d3dd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.275298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f485c0-885f-4da7-9f18-967c4f672a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.275978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f485c0-885f-4da7-9f18-967c4f672a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.276718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f485c0-885f-4da7-9f18-967c4f672a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.276988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f485c0-885f-4da7-9f18-967c4f672a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.277721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f485c0-885f-4da7-9f18-967c4f672a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.279515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f485c0-885f-4da7-9f18-967c4f672a82 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.281821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f3b34eff-31f7-4978-8dd3-0bd7d51ac4d6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.282994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f3b34eff-31f7-4978-8dd3-0bd7d51ac4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.289696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 789/1552] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:51.291319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0847c2f-aa5f-4c9e-ac58-6a56c65090ca None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.291692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 764/1553] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.291817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0847c2f-aa5f-4c9e-ac58-6a56c65090ca None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.291900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0847c2f-aa5f-4c9e-ac58-6a56c65090ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.292801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.293306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.293423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.311463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.312718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.314903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d0847c2f-aa5f-4c9e-ac58-6a56c65090ca None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.316059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d0847c2f-aa5f-4c9e-ac58-6a56c65090ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.321187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 765/1554] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.321973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.323855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 790/1555] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.330907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2c1b-caaf-4174-8393-7150b6a1f7b4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.330907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2c1b-caaf-4174-8393-7150b6a1f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.330907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2c1b-caaf-4174-8393-7150b6a1f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.332920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88ac9c-095a-4fbd-805a-f20f7bd495bc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.338657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813cd75-a7aa-44cc-aa7a-1517cf23bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.339330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813cd75-a7aa-44cc-aa7a-1517cf23bcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.339636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813cd75-a7aa-44cc-aa7a-1517cf23bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.339900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813cd75-a7aa-44cc-aa7a-1517cf23bcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.340633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813cd75-a7aa-44cc-aa7a-1517cf23bcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.342557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813cd75-a7aa-44cc-aa7a-1517cf23bcd8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.345532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c80c2c1b-caaf-4174-8393-7150b6a1f7b4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.346712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c80c2c1b-caaf-4174-8393-7150b6a1f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.355849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 791/1556] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.357435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.357835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.358146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.366412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 766/1557] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:51.367648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203542bb-b734-437a-8434-8a67316d14fb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.367936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203542bb-b734-437a-8434-8a67316d14fb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.368215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203542bb-b734-437a-8434-8a67316d14fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.374621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:51.379946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.381218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.387966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-203542bb-b734-437a-8434-8a67316d14fb None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.389161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-203542bb-b734-437a-8434-8a67316d14fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.390333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 792/1558] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.391100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.397605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 767/1559] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.398998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090775ea-7dc7-4acc-a95e-104376a892de None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.399382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090775ea-7dc7-4acc-a95e-104376a892de None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.399790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090775ea-7dc7-4acc-a95e-104376a892de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.400836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3ec76-08c1-4408-ab5f-73184c6371bb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.406256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.406947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.407976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.407976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.408285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.410004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.418590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-090775ea-7dc7-4acc-a95e-104376a892de None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.419761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-090775ea-7dc7-4acc-a95e-104376a892de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.423271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 793/1560] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:51.423271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.430623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 768/1561] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.432977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e18dbf-3676-4406-9daa-fe13912c449c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.435467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.435763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.436042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.438148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.438826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.439110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.439382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.440108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:51.440431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.442157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb3a1-c87e-427a-ac5c-06e73c6e8715 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.449270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:51.454844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.456170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.456297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 794/1562] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:51.461815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.462099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.462419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.464863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 769/1563] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.469343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.479076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c359-a6f9-4350-894f-bb88810111c1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.480681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.481888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.484020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.484696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.484981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.485276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.486010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.487611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.490303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 795/1564] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.491147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.499066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 770/1565] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:51.499748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.500691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5679ca-2db8-400b-8c7f-796beabb5333 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.505706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.506292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.506559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.506833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.507622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:51.507935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.509568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.511054 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd57b4-ae56-407c-be50-0eb04df27c48 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.516390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.517096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.517371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.517637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.518381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:51.518682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.520250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.521105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 796/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:51.521866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.531542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1dbc7-ab62-4dd2-b92b-7005e929175e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.533253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 771/1567] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:51.533924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.543495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.544372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.544698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.544973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] PATH_INFO: `/v3/projects/7d046780487b48a9b4103ad7dae31e96/users/c11a5c8e655244cf9396936dca12f176/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.550938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96f4fe-3bf7-429d-98b6-cff0cd48eedf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.555495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.556142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.556428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.556737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.557463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:51.557770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.559399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.559542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d046780487b48a9b4103ad7dae31e96, user_id=c11a5c8e655244cf9396936dca12f176, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.562199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.572136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 772/1568] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:51.573051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.582028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 797/1569] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:51 2022] PUT /identity/v3/projects/7d046780487b48a9b4103ad7dae31e96/users/c11a5c8e655244cf9396936dca12f176/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:51.582885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dc874-19e5-40d4-b5f4-57573bf65762 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.583020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.643338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04383296-e785-447f-968e-6f31f237a6d3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.645210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.645880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.646159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.646429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.647122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.647994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.649102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.649358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.649650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.650079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.650815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:51.651125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.652765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.664345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 798/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:51.665387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.675337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237564a-a96c-4f3d-bb87-e2719cb534ed admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.676512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 773/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:51.677157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.732808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.733507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.733784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.734055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.734767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:39:51.735073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.735985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c16c0-fefb-4c91-923d-87a5967a6e77 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.736731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.740616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.741284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.741557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.741820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.742601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.744178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.748284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 799/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:39:51.749106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.758519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37ee33-c90b-4f07-9078-a8a2780ad544 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.759020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 774/1573] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:51.759919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.763117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.763882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.764172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.764444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.765168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.767070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.769551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c5be6-3562-4a62-882e-1a0ca8b171ca admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.774234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21769b-464a-491a-b8f8-200619d24120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.774875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21769b-464a-491a-b8f8-200619d24120 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.775158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21769b-464a-491a-b8f8-200619d24120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.775438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21769b-464a-491a-b8f8-200619d24120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.776116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21769b-464a-491a-b8f8-200619d24120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.778041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21769b-464a-491a-b8f8-200619d24120 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.794272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 800/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:51.795276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.806068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 775/1575] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:51.807640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388499-e806-4829-992c-a8f847824f9f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.807939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388499-e806-4829-992c-a8f847824f9f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.808217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388499-e806-4829-992c-a8f847824f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.814999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:51.817567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:51.836305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-64388499-e806-4829-992c-a8f847824f9f None None] MFA Rules not processed for user `c11a5c8e655244cf9396936dca12f176`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:51.837738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64388499-e806-4829-992c-a8f847824f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:51.861398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113660a-3fbe-4b40-9b2e-94bb3379b8d5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:51.903593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 776/1576] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:51.904683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388499-e806-4829-992c-a8f847824f9f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.920859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:51.921534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:51.921813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:51.922105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:51.922786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:51.924725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:51.954120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 801/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:51.954120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:51.968041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388499-e806-4829-992c-a8f847824f9f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.013585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c337396-455d-48d1-b7ea-daf1e96c6b7a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.018353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.019033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.019349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.019622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.020311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.021397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:39:52.021397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:39:52.021397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:39:52.022307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.022597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.022979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.023368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.023644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.024315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.026244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.044787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 802/1578] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.045753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.053491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 777/1579] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:51 2022] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.054590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.060577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2f9f-67c8-4c42-b34a-249195e56660 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.084177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:52.100361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:52.117235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.118032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.118289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d57158-78a4-43a7-968a-76c751f793f5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.118489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.118853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.119652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.121665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.123639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.124709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.125001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.125279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] PATH_INFO: `/v3/projects/b7ea110e9bb54809b765897bb6d69811/users/6bea3f54f3b2472480f16b6947598ab6/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.140085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ea110e9bb54809b765897bb6d69811, user_id=6bea3f54f3b2472480f16b6947598ab6, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.141278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:39:52.141278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:39:52.141278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:39:52.143248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.148848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 803/1580] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.149995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.158474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 778/1581] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:52 2022] PUT /identity/v3/projects/b7ea110e9bb54809b765897bb6d69811/users/6bea3f54f3b2472480f16b6947598ab6/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:52.159262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.216894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7f1a-612e-4652-87cd-14a0bfb0472d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.220446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31bd54-350e-44ea-a17c-de28004f29ce admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.221566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.222241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.222514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.222778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.223457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.225079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.225424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.225755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.226078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.226373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.227069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.229102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.248548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 804/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.249446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.252690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 779/1583] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.253586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.267499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbfcba-3714-49fb-a21e-be6e602b01b2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.273464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.274132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.274411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.274681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.275369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.277673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.304432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 780/1584] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.305373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.307372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f743c-ce11-45f1-bec1-7f3b51fcc602 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.311383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc19a8-f55a-44d1-8a59-d60bd7a3e6f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.311995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc19a8-f55a-44d1-8a59-d60bd7a3e6f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.312299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc19a8-f55a-44d1-8a59-d60bd7a3e6f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.312568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc19a8-f55a-44d1-8a59-d60bd7a3e6f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.316917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd52d1-d426-408b-b627-b415fa4c3e70 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.322315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.322938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.323215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.323481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.324200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.325844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.336814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 781/1585] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.340604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.349777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80b81b-a5b9-42a2-9782-0b2e60f67749 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.354345 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.354981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.355263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.355529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.356201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.358120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.371575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc19a8-f55a-44d1-8a59-d60bd7a3e6f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.373251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc19a8-f55a-44d1-8a59-d60bd7a3e6f1 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.378598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 782/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/users => generated 281 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.381437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.383130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 805/1587] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:52.384418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.384741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.385023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.391613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f5fa4-dbf2-4c1b-aa65-e2ff2c7c243c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.396290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.397056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.397406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.397717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.398542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.400598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.402490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:52.403725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:52.416864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 806/1588] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:52.417708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.428257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:52.429922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 783/1589] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:52 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:52.430934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.433936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c29a9-c9a2-4cf3-aa97-cd2b9acd8fd5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.440709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.440892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42d46-3304-4fa3-9268-a789a6fffa52 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.441509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.441859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.442176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.442914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.444596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.445998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.446720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.447064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.447398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.448215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.449917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.456217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 807/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.460040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.463021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 784/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.464575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.470012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d98e-fb49-4c38-b030-4dd9d13720f4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.476158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.476960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.477196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.477472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.478193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.478916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8696ee-2576-4481-87e2-ded603fe734d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.479805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.483613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.484348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.484728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.485066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.485870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.487524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.490238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 808/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.491328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.500974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e015c08-b1c6-4f57-bcc0-47740dc63146 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.504440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 785/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.504440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.508259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.509143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.509412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.509685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.510458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.512421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.518698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:52.528563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 809/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.529963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.543207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dccf99-622a-45aa-b4b7-476bba60640f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.549356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.550231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.550825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.551242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.551964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.553607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.564227 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 810/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.565183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.569530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb60b4e-8869-45fa-a4b8-e5004ec502a1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.573400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.574132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.574481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.574823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.575704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7fb01-d0fc-4af5-8400-6717eb702444 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.580308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.581661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.582187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.582703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.584372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.587037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.587178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.588707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.600091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 786/1596] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:52.600868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.605678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 811/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.607351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.614167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b057e1-ef37-4d8e-83cc-adc03b763daf service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.620407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.621336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.621781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.622195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.623040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.624520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2d4d9-a866-46d4-adfc-a1bcc7e1ae06 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.625005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.630238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.631146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.631585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.631858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.632661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.634295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.636514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 787/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.637290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.650116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589a239-185b-47d3-a095-eeec5aa8ce0a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.650799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 812/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.651885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.656150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.657203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.657555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.657911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] PATH_INFO: `/v3/projects/cd59e48c1ea74bbf850b9174ea149aec/users/c49382061e174a7b8f688a8d1d604df0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.663278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0376-5ef9-46fa-af45-16558857eb22 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.668661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.669404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.669904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.670051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.670829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.672435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.676026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd59e48c1ea74bbf850b9174ea149aec, user_id=c49382061e174a7b8f688a8d1d604df0, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.679508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.686642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 813/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.687513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.699570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21d903-b175-4e8a-a3b3-02bf934e800a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.699944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 788/1601] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:52 2022] PUT /identity/v3/projects/cd59e48c1ea74bbf850b9174ea149aec/users/c49382061e174a7b8f688a8d1d604df0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:52.701117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.781692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2412d0-e89b-46c8-ada0-2a07d66146e3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.786750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.787113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.787879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.788255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.788648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.788825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] PATH_INFO: `/v3/projects/baa0ca30598d473d8f03ef71fadbdeb8/users/a47f45eaf4f444f8a86530b856e69473/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.789353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.789779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.791585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.795344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.812558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 814/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:52.812558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.821181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa0ca30598d473d8f03ef71fadbdeb8, user_id=a47f45eaf4f444f8a86530b856e69473, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.824525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.827838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98805643-80af-40e9-828d-ec81ad6838c8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.836556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:52.838470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:52.838856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:52.839253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] PATH_INFO: `/v3/projects/98a486634f244f12bc1c631c4728221e/users/6d96e57d7b984d818ad02a2c60420d9b/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:52.844082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 789/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:52 2022] PUT /identity/v3/projects/baa0ca30598d473d8f03ef71fadbdeb8/users/a47f45eaf4f444f8a86530b856e69473/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:52.845306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.858771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a486634f244f12bc1c631c4728221e, user_id=6d96e57d7b984d818ad02a2c60420d9b, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:52.862949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:52.886758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 815/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:52 2022] PUT /identity/v3/projects/98a486634f244f12bc1c631c4728221e/users/6d96e57d7b984d818ad02a2c60420d9b/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:52.888286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:52.931363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0a37b-8320-4a32-8991-57e8db28fe39 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:52.946418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:52.980191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324bb68-008c-4c71-b913-bcca0c7f18be admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.013590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55078166-8e83-4565-83ad-30d079fb47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.015320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078166-8e83-4565-83ad-30d079fb47d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.015921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078166-8e83-4565-83ad-30d079fb47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.016373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55078166-8e83-4565-83ad-30d079fb47d9 admin admin] PATH_INFO: `/v3/projects/eaf8c8efda534512ab3d8c7f976a935e/users/9ce69882676b4844a1feeb810a09760b/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.027615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.028705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.029421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.029835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] PATH_INFO: `/v3/projects/72c7bf1feb634a2f970c2a25465659aa/users/631731ac97534e58b9b7e573780a8834/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.034824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:53.037132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078166-8e83-4565-83ad-30d079fb47d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf8c8efda534512ab3d8c7f976a935e, user_id=9ce69882676b4844a1feeb810a09760b, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.040431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55078166-8e83-4565-83ad-30d079fb47d9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.054136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c7bf1feb634a2f970c2a25465659aa, user_id=631731ac97534e58b9b7e573780a8834, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.057745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.077359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 790/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:52 2022] PUT /identity/v3/projects/eaf8c8efda534512ab3d8c7f976a935e/users/9ce69882676b4844a1feeb810a09760b/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:53.078921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b50c-8642-464d-9d62-6e245e3fca8c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.079533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b50c-8642-464d-9d62-6e245e3fca8c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.079967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b50c-8642-464d-9d62-6e245e3fca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.096613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 816/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:52 2022] PUT /identity/v3/projects/72c7bf1feb634a2f970c2a25465659aa/users/631731ac97534e58b9b7e573780a8834/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:53.096613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:53.131136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f4e5b50c-8642-464d-9d62-6e245e3fca8c None None] MFA Rules not processed for user `c49382061e174a7b8f688a8d1d604df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.133257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f4e5b50c-8642-464d-9d62-6e245e3fca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.224329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b510090-a1ac-4ef0-b1a9-49bffa9f5320 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.229391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26781bf1-7b9b-4d86-b708-1f22c7899d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.230292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26781bf1-7b9b-4d86-b708-1f22c7899d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.230576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26781bf1-7b9b-4d86-b708-1f22c7899d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.230853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26781bf1-7b9b-4d86-b708-1f22c7899d69 admin admin] PATH_INFO: `/v3/projects/e2be1f0c5365430b9adbfb142380de81/users/ab9a8ac4b190470fa49979ec2a5ed296/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.250894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26781bf1-7b9b-4d86-b708-1f22c7899d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2be1f0c5365430b9adbfb142380de81, user_id=ab9a8ac4b190470fa49979ec2a5ed296, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.253992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26781bf1-7b9b-4d86-b708-1f22c7899d69 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.262922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 791/1607] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:53.264450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b62e1-be30-4fd3-897d-3b9e665c57ac None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.264829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b62e1-be30-4fd3-897d-3b9e665c57ac None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.265176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b62e1-be30-4fd3-897d-3b9e665c57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.277643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 817/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:53 2022] PUT /identity/v3/projects/e2be1f0c5365430b9adbfb142380de81/users/ab9a8ac4b190470fa49979ec2a5ed296/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:53.279138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7d871-74c4-4618-bea7-5a40300d139f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.279496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7d871-74c4-4618-bea7-5a40300d139f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.279844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7d871-74c4-4618-bea7-5a40300d139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.288328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e14b62e1-be30-4fd3-897d-3b9e665c57ac None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.290109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e14b62e1-be30-4fd3-897d-3b9e665c57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.326094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aee7d871-74c4-4618-bea7-5a40300d139f None None] MFA Rules not processed for user `6d96e57d7b984d818ad02a2c60420d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.328381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aee7d871-74c4-4618-bea7-5a40300d139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.388764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 792/1609] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:53.390841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b060c-12d8-471b-8e0b-a14795fe6a64 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.391151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b060c-12d8-471b-8e0b-a14795fe6a64 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.391432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b060c-12d8-471b-8e0b-a14795fe6a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.424106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0a5b060c-12d8-471b-8e0b-a14795fe6a64 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.425330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a5b060c-12d8-471b-8e0b-a14795fe6a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.439333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 793/1610] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:53.439333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa861-eb16-4129-a5fe-a2d6c2a1112a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.439333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa861-eb16-4129-a5fe-a2d6c2a1112a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.439333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa861-eb16-4129-a5fe-a2d6c2a1112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.463843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 818/1611] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:53.463843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.463843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.463843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.469951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ec2aa861-eb16-4129-a5fe-a2d6c2a1112a None None] MFA Rules not processed for user `631731ac97534e58b9b7e573780a8834`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.470984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec2aa861-eb16-4129-a5fe-a2d6c2a1112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.481700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:53.498230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] MFA Rules not processed for user `ab9a8ac4b190470fa49979ec2a5ed296`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.499829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.554134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:53.567958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 794/1612] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:53.572879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034effd9-286b-4d24-a6a0-cba26a396f6c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.573186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034effd9-286b-4d24-a6a0-cba26a396f6c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.573474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034effd9-286b-4d24-a6a0-cba26a396f6c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.578830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 795/1613] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jul 21 05:39:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:39:53.579613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034effd9-286b-4d24-a6a0-cba26a396f6c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:53.589129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 819/1614] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:53.590149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:53.660827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034effd9-286b-4d24-a6a0-cba26a396f6c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.663492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a21c9b-30d5-45af-9515-ab763e955430 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.666106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.666956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.667331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.667612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.668902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.669629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.670084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.671110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.679416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.683269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.686591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.689410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.705407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 820/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:53.706950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:53.707474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 796/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:53.709094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:53.729453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffa9e6-023d-4034-97b4-460033bc8206 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.735577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c458dd-774d-40a9-9a1c-84e3d1e6bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.736660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c458dd-774d-40a9-9a1c-84e3d1e6bc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.737117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c458dd-774d-40a9-9a1c-84e3d1e6bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.737556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c458dd-774d-40a9-9a1c-84e3d1e6bc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.738573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c458dd-774d-40a9-9a1c-84e3d1e6bc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.740905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c458dd-774d-40a9-9a1c-84e3d1e6bc03 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.744124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffc48-4144-4f1c-81d2-682dd4e4badc service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.756454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.757495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.757799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.759836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.760668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.767829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.773888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 821/1617] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:53.775517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.775974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.776593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.837179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 797/1618] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:53.838224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:53.855468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:53.856760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:53.929160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc6ac0-70ca-446d-86a0-8d26a5d4a3c9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:53.936786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:53.937485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:53.937909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:53.938270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:53.939040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:53.941848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:53.987060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 798/1619] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:53.992452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.011363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:54.011788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 822/1620] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:54.021615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.042316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33f8e4-9e07-4687-897d-de97339778f7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.129657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8e93e-bbc3-44ef-8320-6a8f2ad7b9f1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.145647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.146355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.146636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.146910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.150772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:54.153507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.155575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.184845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.185638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.185944 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.186210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.186993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.189478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.203643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 799/1621] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:53 2022] POST /identity/v3/users => generated 309 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:54.204562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.221294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927b1f-2448-4e52-ad71-466fdd180dac admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.237040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 823/1622] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:54 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:54.238202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.239988 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.240799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.241143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.242689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.243769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.249291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.300255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 800/1623] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:39:54 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:39:54.304442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.338855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448c52-e71e-4971-b3e0-91fbbc7030c0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.348135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.349259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.349621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.349967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.350797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.354268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.376055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11100bff-33dd-413f-92d2-f3beb7f98f75 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.379307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 801/1624] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:54.380324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.385923 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.386605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.387017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.387131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.409134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06990da2-7d73-4d38-9508-bbb2ce7ce1da admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.416797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.417591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.417940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.418277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.419180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.422757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.448255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 802/1625] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:54.448255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.471832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c94ac6-2c20-4f90-815e-0d35e1b143eb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.481783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.482648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.483029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.483397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.484234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.486006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.513405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 803/1626] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:54.516227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.533049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.535065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e52d4-c9ae-4e30-8290-019e9d5556ab admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.536383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.548136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.550625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.551015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.551392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] PATH_INFO: `/v3/projects/3b9e6e7921044ebfbf11a1f869cabfe6/users/bfcd271d6e3041018d94bf25e1b76b36/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.556242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 824/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:54.558090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.570658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ccfb6-3d4d-46e8-a874-88d7c2265c48 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.584046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.585963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.586772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.587187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] PATH_INFO: `/v3/projects/ca3d3bd412ae47c58dbb137741f07854/users/4c32c9d2eb8b4e2a9c68030e8d983e88/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.608938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e6e7921044ebfbf11a1f869cabfe6, user_id=bfcd271d6e3041018d94bf25e1b76b36, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.611712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.618548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3d3bd412ae47c58dbb137741f07854, user_id=4c32c9d2eb8b4e2a9c68030e8d983e88, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.643012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.654785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 804/1628] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:54 2022] PUT /identity/v3/projects/3b9e6e7921044ebfbf11a1f869cabfe6/users/bfcd271d6e3041018d94bf25e1b76b36/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:54.658075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.669795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 825/1629] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:54 2022] PUT /identity/v3/projects/ca3d3bd412ae47c58dbb137741f07854/users/4c32c9d2eb8b4e2a9c68030e8d983e88/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:54.671346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.738262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:54.870060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a9957-1663-4878-90be-2831133ee67b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.870060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.870060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.870060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.871145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.871145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.871145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.871529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f803e-b5f1-4f3e-8aad-b6a28d2a2239 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.871905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 826/1630] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:54.871905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.872074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.872074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.872074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.872074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] PATH_INFO: `/v3/projects/be33c07f52964765ada5166c387d3dcf/users/dede37d4005040c18b79d00eef610ee5/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.872431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db4ca2-7cea-4a60-9868-0301b1bc91d1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:54.875632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be33c07f52964765ada5166c387d3dcf, user_id=dede37d4005040c18b79d00eef610ee5, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.877828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.896146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:54.916304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 805/1631] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:54 2022] PUT /identity/v3/projects/be33c07f52964765ada5166c387d3dcf/users/dede37d4005040c18b79d00eef610ee5/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:54.917287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.918038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:54.918482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:54.918994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:54.920048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:54.922729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:54.947144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:54.953377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 827/1632] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:54.954690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:54.969728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28f01-474a-4c18-8a80-b54e023c814c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:55.057846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e71633-1baa-4b59-b8f8-7e32107e7497 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:55.066316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:55.067026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.067294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.067968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.068805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:55.070137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffdf3a-e35c-4067-976d-8525e3d8e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:55.070865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:55.071577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdf3a-e35c-4067-976d-8525e3d8e811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.071859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdf3a-e35c-4067-976d-8525e3d8e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.072139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdf3a-e35c-4067-976d-8525e3d8e811 admin admin] PATH_INFO: `/v3/projects/3b9e6e7921044ebfbf11a1f869cabfe6/users/bfcd271d6e3041018d94bf25e1b76b36/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.077114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdf3a-e35c-4067-976d-8525e3d8e811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e6e7921044ebfbf11a1f869cabfe6, user_id=bfcd271d6e3041018d94bf25e1b76b36, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:55.079767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffdf3a-e35c-4067-976d-8525e3d8e811 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:55.094178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 828/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:39:55.094178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:55.107512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e85053-3e97-485a-8b35-a62e476340fe admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:55.109428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 806/1634] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:54 2022] PUT /identity/v3/projects/3b9e6e7921044ebfbf11a1f869cabfe6/users/bfcd271d6e3041018d94bf25e1b76b36/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:55.117991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83270-e84f-4549-8e5b-8177d65db0b1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.118532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83270-e84f-4549-8e5b-8177d65db0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.118969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83270-e84f-4549-8e5b-8177d65db0b1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.120941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 807/1635] 10.222.0.18 () {54 vars in 962 bytes} [Thu Jul 21 05:39:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:39:55.121857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83270-e84f-4549-8e5b-8177d65db0b1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:55.207910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4772-3376-4df9-9aed-4f639e5beac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:55.208905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4772-3376-4df9-9aed-4f639e5beac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.209168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4772-3376-4df9-9aed-4f639e5beac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.209442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4772-3376-4df9-9aed-4f639e5beac4 admin admin] PATH_INFO: `/v3/projects/ca3d3bd412ae47c58dbb137741f07854/users/4c32c9d2eb8b4e2a9c68030e8d983e88/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.211479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a4772-3376-4df9-9aed-4f639e5beac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3d3bd412ae47c58dbb137741f07854, user_id=4c32c9d2eb8b4e2a9c68030e8d983e88, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:55.214184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a4772-3376-4df9-9aed-4f639e5beac4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:55.227105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 829/1636] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:55 2022] PUT /identity/v3/projects/ca3d3bd412ae47c58dbb137741f07854/users/4c32c9d2eb8b4e2a9c68030e8d983e88/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:55.228510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b0e2-2046-4029-acac-a7f7ba657cf3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.228803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b0e2-2046-4029-acac-a7f7ba657cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.229073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b0e2-2046-4029-acac-a7f7ba657cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.267057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83270-e84f-4549-8e5b-8177d65db0b1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:55.270879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7c63b0e2-2046-4029-acac-a7f7ba657cf3 None None] MFA Rules not processed for user `bfcd271d6e3041018d94bf25e1b76b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:55.272254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c63b0e2-2046-4029-acac-a7f7ba657cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:55.339016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:55.355921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf44ad-3b28-4166-b7fe-60dbd7ff32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:55.356889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf44ad-3b28-4166-b7fe-60dbd7ff32d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.357279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf44ad-3b28-4166-b7fe-60dbd7ff32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.357501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf44ad-3b28-4166-b7fe-60dbd7ff32d0 admin admin] PATH_INFO: `/v3/projects/be33c07f52964765ada5166c387d3dcf/users/dede37d4005040c18b79d00eef610ee5/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.360176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf44ad-3b28-4166-b7fe-60dbd7ff32d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be33c07f52964765ada5166c387d3dcf, user_id=dede37d4005040c18b79d00eef610ee5, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:55.363448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf44ad-3b28-4166-b7fe-60dbd7ff32d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:55.378194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 830/1637] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:55.380173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906a089-a9b3-4972-8348-001b19a8c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.380730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906a089-a9b3-4972-8348-001b19a8c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.384004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906a089-a9b3-4972-8348-001b19a8c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.392609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 808/1638] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:39:55 2022] PUT /identity/v3/projects/be33c07f52964765ada5166c387d3dcf/users/dede37d4005040c18b79d00eef610ee5/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:55.392609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e382-891f-43d0-a9b5-59c4a4f2c296 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.392609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e382-891f-43d0-a9b5-59c4a4f2c296 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.392609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e382-891f-43d0-a9b5-59c4a4f2c296 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.393403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 809/1639] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jul 21 05:39:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:39:55.396131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a135-6151-4800-a8d6-ed857c19d84a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.396805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a135-6151-4800-a8d6-ed857c19d84a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.398441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868a135-6151-4800-a8d6-ed857c19d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.431543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1906a089-a9b3-4972-8348-001b19a8c3a4 None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:55.434598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1906a089-a9b3-4972-8348-001b19a8c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:55.454617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3868a135-6151-4800-a8d6-ed857c19d84a None None] MFA Rules not processed for user `4c32c9d2eb8b4e2a9c68030e8d983e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:55.458628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3868a135-6151-4800-a8d6-ed857c19d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:55.515013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:55.547404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 831/1640] 10.222.0.18 () {58 vars in 1059 bytes} [Thu Jul 21 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:55.549594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515327-07db-40b4-87d0-c58c4a2ab324 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.549895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515327-07db-40b4-87d0-c58c4a2ab324 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.550445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515327-07db-40b4-87d0-c58c4a2ab324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.586034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 810/1641] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:55.586034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.586034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.586034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.623438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:55.625022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:55.625839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f6515327-07db-40b4-87d0-c58c4a2ab324 None None] MFA Rules not processed for user `dede37d4005040c18b79d00eef610ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:55.627096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f6515327-07db-40b4-87d0-c58c4a2ab324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:55.661165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 811/1642] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:55.662500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:55.775615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 832/1643] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:55.777077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327f82-35a5-46a3-aedf-3eb8e237ca7e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.777418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327f82-35a5-46a3-aedf-3eb8e237ca7e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.777689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327f82-35a5-46a3-aedf-3eb8e237ca7e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.779122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 833/1644] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jul 21 05:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:39:55.779883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327f82-35a5-46a3-aedf-3eb8e237ca7e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:55.824826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7cea8-164b-4332-bde7-f3fcdfee2e5b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:55.829984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:55.832854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.833252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.833691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.877472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327f82-35a5-46a3-aedf-3eb8e237ca7e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:55.886500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5754aaa-ac15-4b59-b708-051fd1296c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:55.889782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5754aaa-ac15-4b59-b708-051fd1296c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.890439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5754aaa-ac15-4b59-b708-051fd1296c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.891730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5754aaa-ac15-4b59-b708-051fd1296c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.923698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5754aaa-ac15-4b59-b708-051fd1296c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:55.925470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5754aaa-ac15-4b59-b708-051fd1296c1c service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:55.945104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 834/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:55.947812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:55.949215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:55.949556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:55.983574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:55.996623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:56.000700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:56.001970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:56.002980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:56.028953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 812/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:56.029235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 835/1647] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:56.114998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:56.131019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8cfbe-fd1a-498e-be61-78eefeadd08a service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:56.145708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:56.146427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:56.146897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:56.147124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:56.159197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:56.170426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:56.171895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:56.174834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045c678-6932-43f0-9516-15b240d0cab3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:56.184273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:56.185029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:56.185295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:56.185565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:56.200093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 813/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:56.292769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:56.294365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:56.319808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 836/1649] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:56.734285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:56.743756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23686a-f400-4111-ba87-ce670e93614a service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:56.747763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b274b-62b6-4b77-965b-31a668d44c16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:56.748598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b274b-62b6-4b77-965b-31a668d44c16 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:56.748887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b274b-62b6-4b77-965b-31a668d44c16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:56.749160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b274b-62b6-4b77-965b-31a668d44c16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:56.771490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b274b-62b6-4b77-965b-31a668d44c16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:56.777151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b274b-62b6-4b77-965b-31a668d44c16 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:56.809700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 814/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:57.623822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:57.747022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bba29-b58e-4ddd-8df5-5f8a16df157b service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:57.754564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:57.756027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:57.756624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:57.757252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] PATH_INFO: `/v3/users/6d96e57d7b984d818ad02a2c60420d9b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:57.760235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d96e57d7b984d818ad02a2c60420d9b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:57.762997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:57.870202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d96e57d7b984d818ad02a2c60420d9b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:57.915029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d96e57d7b984d818ad02a2c60420d9b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:57.919637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d96e57d7b984d818ad02a2c60420d9b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:57.946969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d96e57d7b984d818ad02a2c60420d9b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:57.958529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d96e57d7b984d818ad02a2c60420d9b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:57.976771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 837/1651] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:39:57 2022] DELETE /identity/v3/users/6d96e57d7b984d818ad02a2c60420d9b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:57.981818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:57.983394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:57.983394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:58.036085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:58.037398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:58.208072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:58.256800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 815/1652] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:39:58.352096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:58.354015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:58.446934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:39:58.532981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bba2a-9cff-4b4b-b237-385d1ea3ff88 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:58.553287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a1f01-8e0f-4ad4-9670-2a0bedc71dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:58.555734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1f01-8e0f-4ad4-9670-2a0bedc71dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:58.557296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1f01-8e0f-4ad4-9670-2a0bedc71dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:58.558460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1f01-8e0f-4ad4-9670-2a0bedc71dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:58.581336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a1f01-8e0f-4ad4-9670-2a0bedc71dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:58.586010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a1f01-8e0f-4ad4-9670-2a0bedc71dc4 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:58.615352 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 838/1653] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:39:59.265516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:59.267119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:59.299186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68987b-de39-43c1-a175-573cf92d27fd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:39:59.312777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:39:59.313699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:59.313983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:59.314260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] PATH_INFO: `/v3/users/631731ac97534e58b9b7e573780a8834` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:59.315871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631731ac97534e58b9b7e573780a8834)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:39:59.322858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:39:59.322858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 21 05:39:59.322858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: Jul 21 05:39:59.324108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:39:59.497935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631731ac97534e58b9b7e573780a8834'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:59.513653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631731ac97534e58b9b7e573780a8834'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:59.514481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631731ac97534e58b9b7e573780a8834'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:59.537287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631731ac97534e58b9b7e573780a8834'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:59.538340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631731ac97534e58b9b7e573780a8834'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:39:59.605091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 816/1654] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:39:59 2022] DELETE /identity/v3/users/631731ac97534e58b9b7e573780a8834 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:39:59.606629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:39:59.607125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:39:59.607198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:39:59.645744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:39:59.648440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:39:59.831732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 839/1655] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:39:59.861831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:39:59.863446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:00.099960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9acc-9953-426b-9902-ccfdce8707a9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:00.111473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:00.112171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:00.112457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:00.112757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:00.150282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:00.158069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:00.186355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 817/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:00.208900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:00.210948 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:00.324722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6504bd0-e382-4129-99ab-8bcd824db3e8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:00.331714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:00.332742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:00.333332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:00.333832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:00.336099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:00.462056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:00.464413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:00.511441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 840/1657] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:00.575153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:00.576934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:00.601769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b518c-c1d2-4c97-be6a-f52466a7f09d service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:00.611152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:00.612190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:00.612500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:00.612967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] PATH_INFO: `/v3/projects/98a486634f244f12bc1c631c4728221e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:00.615817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a486634f244f12bc1c631c4728221e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:00.618773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:00.718941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a486634f244f12bc1c631c4728221e', 'request_id': 'req-f3129af3-2dbe-43bc-b578-41a259eb23de'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:00.744364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a486634f244f12bc1c631c4728221e', 'request_id': 'req-f3129af3-2dbe-43bc-b578-41a259eb23de'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:00.749144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:00.758704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a486634f244f12bc1c631c4728221e', 'request_id': 'req-f3129af3-2dbe-43bc-b578-41a259eb23de'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:00.779265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] The token cache is being invalidate because project 98a486634f244f12bc1c631c4728221e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:00.779265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:00.779561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:00.787726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:00.788293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 818/1658] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:00 2022] DELETE /identity/v3/projects/98a486634f244f12bc1c631c4728221e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:00.804937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f446c-ef29-4924-927d-7d49b4cb6b7d service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:00.826631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:00.907695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:00.908908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:00.909192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:00.909464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] PATH_INFO: `/v3/users/bfcd271d6e3041018d94bf25e1b76b36` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:00.910675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcd271d6e3041018d94bf25e1b76b36)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:00.912656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:01.018116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcd271d6e3041018d94bf25e1b76b36'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.053404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcd271d6e3041018d94bf25e1b76b36'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.055365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcd271d6e3041018d94bf25e1b76b36'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.079471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcd271d6e3041018d94bf25e1b76b36'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.102120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcd271d6e3041018d94bf25e1b76b36'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.121529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 841/1659] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:00 2022] DELETE /identity/v3/users/bfcd271d6e3041018d94bf25e1b76b36 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:01.478689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:01.480378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:01.506637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3129af3-2dbe-43bc-b578-41a259eb23de admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:01.702086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:01.703015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:01.703294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:01.703728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] PATH_INFO: `/v3/users/c49382061e174a7b8f688a8d1d604df0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:01.707235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49382061e174a7b8f688a8d1d604df0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:01.709556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:01.872297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49382061e174a7b8f688a8d1d604df0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.872966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:01.874755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:01.896877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49382061e174a7b8f688a8d1d604df0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.897193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651d030-aa23-4788-bd2a-bbfafd98c276 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:01.897517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49382061e174a7b8f688a8d1d604df0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.909068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49382061e174a7b8f688a8d1d604df0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.910041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:01.913228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-131cb629-8997-47ec-a2b9-034f6b7120e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49382061e174a7b8f688a8d1d604df0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:01.915085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:01.915791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:01.916078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] PATH_INFO: `/v3/projects/72c7bf1feb634a2f970c2a25465659aa` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:01.917741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c7bf1feb634a2f970c2a25465659aa)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:01.919402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: WARNING py.warnings [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:40:01.919402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: warnings.warn(msg) Jul 21 05:40:01.919402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: Jul 21 05:40:01.923166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:01.967691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 819/1660] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:01 2022] DELETE /identity/v3/users/c49382061e174a7b8f688a8d1d604df0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:01.972527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:01.973084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:01.973456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:02.048343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:02.049799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.079544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c7bf1feb634a2f970c2a25465659aa', 'request_id': 'req-22a3a5a6-0942-4195-9682-2d79caf7e1f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.099793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c7bf1feb634a2f970c2a25465659aa', 'request_id': 'req-22a3a5a6-0942-4195-9682-2d79caf7e1f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.119079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c7bf1feb634a2f970c2a25465659aa', 'request_id': 'req-22a3a5a6-0942-4195-9682-2d79caf7e1f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.182152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] The token cache is being invalidate because project 72c7bf1feb634a2f970c2a25465659aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:02.183277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.186374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-22a3a5a6-0942-4195-9682-2d79caf7e1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.191519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 842/1661] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:01 2022] DELETE /identity/v3/projects/72c7bf1feb634a2f970c2a25465659aa => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:02.200391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:02.200842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:02.201133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:02.220657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 820/1662] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:02.221686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:02.230336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.251263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82300e47-2490-4bed-afd6-8e3b3644bd56 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:02.262436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:02.265347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:02.265811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:02.266387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] PATH_INFO: `/v3/users/4c32c9d2eb8b4e2a9c68030e8d983e88` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:02.269904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c32c9d2eb8b4e2a9c68030e8d983e88)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:02.278831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:02.281382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:02.302817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:02.337677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] MFA Rules not processed for user `6bea3f54f3b2472480f16b6947598ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:02.338964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.414236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c32c9d2eb8b4e2a9c68030e8d983e88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.434215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c32c9d2eb8b4e2a9c68030e8d983e88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.435186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c32c9d2eb8b4e2a9c68030e8d983e88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.448995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c32c9d2eb8b4e2a9c68030e8d983e88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.450456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c32c9d2eb8b4e2a9c68030e8d983e88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.501116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 821/1663] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:02 2022] DELETE /identity/v3/users/4c32c9d2eb8b4e2a9c68030e8d983e88 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:02.504750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:02.511206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.655367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 843/1664] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:02.661716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b2014-5a74-4fee-9caa-ad1f8a7e605a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:02.665988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:02.668911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:02.673386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:02.673386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:02.673386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:02.673386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.674831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.712391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f157c-dbfb-4c0e-bb10-0d5079a3b160 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:02.821089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:02.826416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:02.843790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:02.844725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:02.845011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:02.845290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] PATH_INFO: `/v3/projects/3b9e6e7921044ebfbf11a1f869cabfe6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:02.851928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9e6e7921044ebfbf11a1f869cabfe6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:02.858331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:02.860070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 822/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:02.861018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:02.865661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:02.940002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:02.985588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9e6e7921044ebfbf11a1f869cabfe6', 'request_id': 'req-241fa3c6-4f52-4963-8ac7-bab960404b83'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:02.998901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9e6e7921044ebfbf11a1f869cabfe6', 'request_id': 'req-241fa3c6-4f52-4963-8ac7-bab960404b83'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.026222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9e6e7921044ebfbf11a1f869cabfe6', 'request_id': 'req-241fa3c6-4f52-4963-8ac7-bab960404b83'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.043964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] The token cache is being invalidate because project 3b9e6e7921044ebfbf11a1f869cabfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:03.045886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.048679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-241fa3c6-4f52-4963-8ac7-bab960404b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.054106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 844/1666] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:02 2022] DELETE /identity/v3/projects/3b9e6e7921044ebfbf11a1f869cabfe6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:03.064031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818a78-1b99-4f7e-a74a-a3632649f3b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.064866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818a78-1b99-4f7e-a74a-a3632649f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.066074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4818a78-1b99-4f7e-a74a-a3632649f3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.077751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fceb68-1d9a-4c22-aa24-f33464d30715 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:03.109602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d4818a78-1b99-4f7e-a74a-a3632649f3b9 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:03.111804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d4818a78-1b99-4f7e-a74a-a3632649f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.189009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:03.241006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:03.241905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.243501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 845/1667] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:03.250994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.252626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.252746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.252746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.252746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.258824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.287395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:03.290769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.320902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 846/1668] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:03.328579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:03.333334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.364348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533af51-a888-4a50-8c67-98caba9bdb62 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:03.376999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:03.377975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.378315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.378590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] PATH_INFO: `/v3/projects/ca3d3bd412ae47c58dbb137741f07854` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.384690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3d3bd412ae47c58dbb137741f07854)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:03.386844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:03.444996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:03.448712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:03.474259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 823/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:03.476248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:03.509555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c8df-f42e-4287-a691-c214e8e370bf service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:03.518967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3d3bd412ae47c58dbb137741f07854', 'request_id': 'req-97e26ed3-7947-4218-b811-be1e2544741d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.536591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3d3bd412ae47c58dbb137741f07854', 'request_id': 'req-97e26ed3-7947-4218-b811-be1e2544741d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.556355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3d3bd412ae47c58dbb137741f07854', 'request_id': 'req-97e26ed3-7947-4218-b811-be1e2544741d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.586978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] The token cache is being invalidate because project ca3d3bd412ae47c58dbb137741f07854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:03.587169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.590088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97e26ed3-7947-4218-b811-be1e2544741d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:03.596067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 847/1670] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:03 2022] DELETE /identity/v3/projects/ca3d3bd412ae47c58dbb137741f07854 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:03.601501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05f81-8b0e-49a6-b64e-7a325b49f8aa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.601846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05f81-8b0e-49a6-b64e-7a325b49f8aa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.602163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05f81-8b0e-49a6-b64e-7a325b49f8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.641032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-eda05f81-8b0e-49a6-b64e-7a325b49f8aa None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:03.643660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eda05f81-8b0e-49a6-b64e-7a325b49f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.664190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:03.665976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.666301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.666582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.667331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:03.667644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:03.669312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:03.689790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:03.703218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 824/1671] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:03.710245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:03.725256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.758802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 848/1672] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:03.767197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.767484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.767760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.791470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7d44-cf7c-4bc5-8ac9-3d2fdae7d3f5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:03.793088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:03.794394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:03.803980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:03.804995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.805437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.805847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.806711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:03.814643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 849/1673] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:03.815057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:03.818221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:03.833457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47940f2f-1b9a-4c3d-8c0e-3bc834121cae None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:03.840112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:03.841018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:03.841311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:03.841992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:03.842765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:03.843451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:03.845775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:03.869935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 850/1674] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:03.876522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:03.884127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 825/1675] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:03.885201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:03.914641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385946b-5c67-486c-b624-6270689066ab admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.013862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:04.075032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.076750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.077048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.077320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.078490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.081373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.113959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548dd18-599f-446d-9bbd-bea25339e252 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.139999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.143854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.145082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.146005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.151152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.160850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.170175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 851/1676] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/projects => generated 357 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:04.173386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.220296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 826/1677] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:03 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:04.225242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.242450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617e8e8-c2d5-43e3-8600-7a2228710f5c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.381557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd806d56-f2ff-4fe0-93b7-b9bdaa1a1e9d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.396283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.397116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.397394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.400445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.401127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.403119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.417488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.418822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.419262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.419663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.420631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.422686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.437591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 827/1678] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:04.441507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.458252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60de240-3b5f-4644-b62c-ef87e9aba49f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.471108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.471890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.472406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.472752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.473532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.475533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.482546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 852/1679] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:04 2022] POST /identity/v3/users => generated 279 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:04.487358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.506294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 828/1680] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:04.506567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcd625-73cd-41eb-98fd-78be18981739 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.507754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.511850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.513498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.513831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.514112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.515598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.518108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.529979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5d65-a2cd-450a-8935-93f9f14c61df admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.546485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 853/1681] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:04.546676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083542-1264-40b8-b787-770009babd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.547859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083542-1264-40b8-b787-770009babd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.548403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083542-1264-40b8-b787-770009babd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.548666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.548780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083542-1264-40b8-b787-770009babd6f admin admin] PATH_INFO: `/v3/projects/4b7a79121df240eb9ed8142d24aa39f8/users/94dafd9bde81460db8325c108fcf6c28/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.575737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc54b1-8302-42e3-b401-15172ca30566 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.583765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083542-1264-40b8-b787-770009babd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7a79121df240eb9ed8142d24aa39f8, user_id=94dafd9bde81460db8325c108fcf6c28, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.587216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083542-1264-40b8-b787-770009babd6f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.596198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.596934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.597214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.597500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.598322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.599964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.615099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 829/1682] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:04 2022] PUT /identity/v3/projects/4b7a79121df240eb9ed8142d24aa39f8/users/94dafd9bde81460db8325c108fcf6c28/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:04.624670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 854/1683] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:04.626471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.626835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.627198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.629476 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.652468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4bc7-f531-4647-a288-bb7be428b9d1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.692910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] MFA Rules not processed for user `94dafd9bde81460db8325c108fcf6c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:04.694247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:04.724557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:04.785882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:04.788532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:04.789129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:04.789129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] PATH_INFO: `/v3/projects/0130268bbf8c4872a1c04ed65934e6a8/users/7ee50cc99d5144e9951d234000d5acf0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:04.834600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0130268bbf8c4872a1c04ed65934e6a8, user_id=7ee50cc99d5144e9951d234000d5acf0, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:04.835256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 830/1684] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:04.841289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:04.844923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.866919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a7b2-8776-4b18-9ac2-839c5edc2552 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:04.878909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 855/1685] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:04 2022] PUT /identity/v3/projects/0130268bbf8c4872a1c04ed65934e6a8/users/7ee50cc99d5144e9951d234000d5acf0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:04.895373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:04.901044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:04.927768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:05.066381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113fcb-e9f3-431a-9601-48283e2cb5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.068797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113fcb-e9f3-431a-9601-48283e2cb5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.069098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113fcb-e9f3-431a-9601-48283e2cb5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.069408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113fcb-e9f3-431a-9601-48283e2cb5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.070565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113fcb-e9f3-431a-9601-48283e2cb5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.073201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113fcb-e9f3-431a-9601-48283e2cb5f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.100166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11003bb3-46ad-427a-bf4e-635445cfa27e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.106851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.108761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.109250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.109673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] PATH_INFO: `/v3/projects/cd59e48c1ea74bbf850b9174ea149aec` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.111318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd59e48c1ea74bbf850b9174ea149aec)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.113892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.137292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 831/1686] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:04 2022] POST /identity/v3/projects => generated 363 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:05.138698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162d6a-2dcb-4da9-978c-f4b91cb8b9c2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.139012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162d6a-2dcb-4da9-978c-f4b91cb8b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.139298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162d6a-2dcb-4da9-978c-f4b91cb8b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.213464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c1162d6a-2dcb-4da9-978c-f4b91cb8b9c2 None None] MFA Rules not processed for user `7ee50cc99d5144e9951d234000d5acf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:05.214702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c1162d6a-2dcb-4da9-978c-f4b91cb8b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:05.214823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd59e48c1ea74bbf850b9174ea149aec', 'request_id': 'req-3aa41b77-f478-4b81-b3fd-b18f79274c79'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:05.227153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd59e48c1ea74bbf850b9174ea149aec', 'request_id': 'req-3aa41b77-f478-4b81-b3fd-b18f79274c79'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:05.240846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd59e48c1ea74bbf850b9174ea149aec', 'request_id': 'req-3aa41b77-f478-4b81-b3fd-b18f79274c79'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:05.271053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] The token cache is being invalidate because project cd59e48c1ea74bbf850b9174ea149aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:05.271319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:05.272714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:05.278128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 856/1687] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:04 2022] DELETE /identity/v3/projects/cd59e48c1ea74bbf850b9174ea149aec => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:05.278128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.278128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:05.357420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 832/1688] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:05.358782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.359074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.359354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.400258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:05.401532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:05.459669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa41b77-f478-4b81-b3fd-b18f79274c79 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.462722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 833/1689] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:05.462970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.465758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:05.475079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599ef47-e582-4693-babf-3b3c17a8efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.475849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599ef47-e582-4693-babf-3b3c17a8efe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.476136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599ef47-e582-4693-babf-3b3c17a8efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.476412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599ef47-e582-4693-babf-3b3c17a8efe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.477151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599ef47-e582-4693-babf-3b3c17a8efe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.489623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599ef47-e582-4693-babf-3b3c17a8efe1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.501182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec7ab1-b99a-467c-bde2-895302b3e673 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.511497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.512569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.515728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.517790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.520576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.529589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.542933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 857/1690] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:05 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:05.544783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.545176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.545596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.598145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:05.599401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:05.605856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 834/1691] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:05 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:05.608279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.619678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:05.656325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:05.751799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 858/1692] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:05.752743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.771832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f3f-19b2-463e-8ead-d960be790924 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.777163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74713a-d659-4cc0-b83c-79e5b95e4b76 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.784703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.785417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.785792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.786170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.786905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.789799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.790854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.791139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.791417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.791575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.792419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.793972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.842394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 859/1694] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:05 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:05.842551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 835/1694] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:05.845064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.847562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.873209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a5e7-e1b5-4253-8720-c6daedc8933c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.884506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.885297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.885581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.885857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.886730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.886828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5bdcb-2855-40c4-87d2-058c12e316fc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.893410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.922139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 860/1695] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:05.922371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.923189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:05.924216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.929460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.933792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.940152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:05.940561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:05.944416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:05.949649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e4fd9-0a79-42cf-856e-f4c849804349 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:05.963929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:05.964439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:05.972539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:05.972858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] PATH_INFO: `/v3/projects/43228db32ac54a40b9b502129fc9a05e/users/9ec923f7e3b14595a7cdf42a1b6665ca/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:05.994816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 836/1696] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:05.998638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.016659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43228db32ac54a40b9b502129fc9a05e, user_id=9ec923f7e3b14595a7cdf42a1b6665ca, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.023937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.025247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8d04-6458-4a62-8937-50bc943b0aa4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.035766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.037075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.037424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.038179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] PATH_INFO: `/v3/projects/0406dd20f3544c3d86311ca74beed3e6/users/eb48922c9214416f9c6259b1ae067d39/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.053720 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 861/1697] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:05 2022] PUT /identity/v3/projects/43228db32ac54a40b9b502129fc9a05e/users/9ec923f7e3b14595a7cdf42a1b6665ca/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:06.056035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.114342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0406dd20f3544c3d86311ca74beed3e6, user_id=eb48922c9214416f9c6259b1ae067d39, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.124820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.170158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 837/1698] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:05 2022] PUT /identity/v3/projects/0406dd20f3544c3d86311ca74beed3e6/users/eb48922c9214416f9c6259b1ae067d39/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:06.171875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.286675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc410c6e-3b1d-46ef-893b-44ce788b201a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.357089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fe95-c178-45a0-a66d-30513f7313a3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.373011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.373739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.374029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.374309 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.375061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.377061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.397006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 838/1699] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:06.397960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.428067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.428853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.429133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.429405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.430106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.433019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.436595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280a3fb-9ca5-4437-9a5b-a73dea25a762 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.459127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.459840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.460179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.460449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.461220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.462879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.483989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 862/1700] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:06 2022] POST /identity/v3/projects => generated 373 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:06.484993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.485835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 839/1701] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:06.487653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.497296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:06.507554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03330c-9015-4c19-8a62-384f1478d5eb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.627582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:06.635260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1bf8c-7d23-4bcd-8620-a33c8f5237ad admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.643464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.648080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.648813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.649288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] PATH_INFO: `/v3/projects/43228db32ac54a40b9b502129fc9a05e/users/9ec923f7e3b14595a7cdf42a1b6665ca/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.652053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43228db32ac54a40b9b502129fc9a05e, user_id=9ec923f7e3b14595a7cdf42a1b6665ca, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.656028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dc945-77a4-42af-9842-93a159637e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.656838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dc945-77a4-42af-9842-93a159637e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.657377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dc945-77a4-42af-9842-93a159637e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.657611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dc945-77a4-42af-9842-93a159637e8d admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.658548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.664564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4dc945-77a4-42af-9842-93a159637e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.667285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4dc945-77a4-42af-9842-93a159637e8d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.692158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 863/1702] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:06 2022] PUT /identity/v3/projects/43228db32ac54a40b9b502129fc9a05e/users/9ec923f7e3b14595a7cdf42a1b6665ca/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:06.694797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.717589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 840/1703] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:06 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:06.720262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c288-72c5-4bc9-83a7-e891f52cc5af None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.720771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c288-72c5-4bc9-83a7-e891f52cc5af None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.721679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c288-72c5-4bc9-83a7-e891f52cc5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.759407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c754c288-72c5-4bc9-83a7-e891f52cc5af None None] MFA Rules not processed for user `9ec923f7e3b14595a7cdf42a1b6665ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:06.761805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c754c288-72c5-4bc9-83a7-e891f52cc5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:06.809518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7c97-3fec-4b8d-af2a-b7e14e972481 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.817271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:06.819024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.819408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.821458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] PATH_INFO: `/v3/projects/0406dd20f3544c3d86311ca74beed3e6/users/eb48922c9214416f9c6259b1ae067d39/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.828913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0406dd20f3544c3d86311ca74beed3e6, user_id=eb48922c9214416f9c6259b1ae067d39, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:06.833130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:06.849674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 864/1704] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:06 2022] PUT /identity/v3/projects/0406dd20f3544c3d86311ca74beed3e6/users/eb48922c9214416f9c6259b1ae067d39/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:06.851130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:06.908213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 841/1705] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:06.910408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:06.910408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:06.913115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:06.975909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] MFA Rules not processed for user `eb48922c9214416f9c6259b1ae067d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:06.977178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:06.981746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78817fc7-363b-460c-88d6-a4106e4d7066 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:06.999510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.000004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.000293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.000595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.001340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:07.002984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:07.040748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 865/1706] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:07.052188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.057019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.099183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 842/1707] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:07.100144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.114936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81a38a-3fa5-42bc-8e8b-7a6711c4820b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.122712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.134952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.135539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.135919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.138256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:07.140390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:07.171391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:07.184974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 843/1708] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:07.188151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.196927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.229331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef0f1-c2fa-4450-9709-a533a982c693 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.233107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.233785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.234067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.234339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.245930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23640f-e7cc-4b3f-b85e-a75c7ece7c70 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.261908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.264821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.264821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.266295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] PATH_INFO: `/v3/users/c11a5c8e655244cf9396936dca12f176` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.269361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11a5c8e655244cf9396936dca12f176)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:07.272765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:07.365389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:07.393613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:07.394439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11a5c8e655244cf9396936dca12f176'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:07.399685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:07.426403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11a5c8e655244cf9396936dca12f176'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:07.427058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11a5c8e655244cf9396936dca12f176'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:07.427791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 866/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:07.431975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.437970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.444744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11a5c8e655244cf9396936dca12f176'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:07.445592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11a5c8e655244cf9396936dca12f176'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:07.452835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ece9-15eb-447b-8eea-4845d15f844d service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.464570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.465601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.466601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.467099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.471806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.503137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:07.504071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 844/1710] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:07 2022] DELETE /identity/v3/users/c11a5c8e655244cf9396936dca12f176 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:07.504936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.510002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.512056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cde14-f32f-464b-9478-657b7a63b3c2 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:07.545594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 867/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:07.547466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.547909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.548292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.644464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:07.646398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.713040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d512a-eaab-4a09-8ddd-31386104ce66 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.732311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.733359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.733655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.733933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] PATH_INFO: `/v3/projects/68d631c69f3340d5bef1596ddadd72d9/users/b8b728c50b974faa80a428d3a8ee3ebf/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.765679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d631c69f3340d5bef1596ddadd72d9, user_id=b8b728c50b974faa80a428d3a8ee3ebf, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:07.768321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:07.782673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 868/1712] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:07.783679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.789223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.802353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 845/1713] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:07 2022] PUT /identity/v3/projects/68d631c69f3340d5bef1596ddadd72d9/users/b8b728c50b974faa80a428d3a8ee3ebf/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:07.809260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:07.811816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:07.925188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254842-f18d-4cbd-92f7-bfc00d2ecce4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.931718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1c112-e4a9-4e53-b457-a7eb1911a942 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:07.935144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80615c7-4553-41ff-a500-ed8ad6d2c686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:07.935982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80615c7-4553-41ff-a500-ed8ad6d2c686 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:07.936405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80615c7-4553-41ff-a500-ed8ad6d2c686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:07.936791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80615c7-4553-41ff-a500-ed8ad6d2c686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:07.963632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:07.986884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:08.001590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:08.002396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.002748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.003103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.006156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80615c7-4553-41ff-a500-ed8ad6d2c686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:08.007918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80615c7-4553-41ff-a500-ed8ad6d2c686 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:08.009037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.019912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 846/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:08.038601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.038936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.039223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.099452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] MFA Rules not processed for user `b8b728c50b974faa80a428d3a8ee3ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:08.100803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.186370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:08.192345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eff586-a984-426a-b8b1-b3fd49c570d9 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:08.216134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 869/1715] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:08.224823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.235658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.236235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.283686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] MFA Rules not processed for user `6bea3f54f3b2472480f16b6947598ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:08.285331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.301164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 847/1716] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:08.305841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:08.307322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.329858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3f586-8e22-4392-90bd-8f0b027d7b92 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:08.336138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:08.337397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.337676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.337948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.341678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.430136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 870/1717] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:08.432270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:08.514760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e8749-89b2-48af-abde-7147556f3a3d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:08.530777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93f8cd-2c19-41f8-a49b-32e4f6d4336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:08.533002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93f8cd-2c19-41f8-a49b-32e4f6d4336e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.533554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93f8cd-2c19-41f8-a49b-32e4f6d4336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.534773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93f8cd-2c19-41f8-a49b-32e4f6d4336e admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.535739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93f8cd-2c19-41f8-a49b-32e4f6d4336e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:08.539349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93f8cd-2c19-41f8-a49b-32e4f6d4336e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:08.571188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:08.579688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40939dbd-c473-4d67-9199-b0bde01bda53 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:08.599726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 848/1718] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:08.602913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.605142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.605142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.636265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 871/1719] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:08 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:08.639342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:08.639342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:08.639342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:08.679463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] MFA Rules not processed for user `a47f45eaf4f444f8a86530b856e69473`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:08.680885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.743848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] MFA Rules not processed for user `9ce69882676b4844a1feeb810a09760b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:08.745168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:08.778522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:08.797594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 849/1720] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:08.799823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:08.896425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:08.944362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 872/1721] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:08.945336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:08.946894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.007089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5e4c6-e631-44eb-8826-3051f5035c03 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.019629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.020340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.020643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.020927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.021708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.026617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.072745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 850/1722] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:08 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:09.072966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870868-7d27-4632-a5ee-f17b20bd95f2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.073053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.077569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.078959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.080170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.080687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.081273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] PATH_INFO: `/v3/projects/7d046780487b48a9b4103ad7dae31e96` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.082856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d046780487b48a9b4103ad7dae31e96)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.085527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.165393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d046780487b48a9b4103ad7dae31e96', 'request_id': 'req-daa80d61-a3fc-421d-be47-68fd20ed837d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:09.176559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d046780487b48a9b4103ad7dae31e96', 'request_id': 'req-daa80d61-a3fc-421d-be47-68fd20ed837d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:09.188672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d046780487b48a9b4103ad7dae31e96', 'request_id': 'req-daa80d61-a3fc-421d-be47-68fd20ed837d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:09.212605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] The token cache is being invalidate because project 7d046780487b48a9b4103ad7dae31e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:09.213266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:09.215356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-daa80d61-a3fc-421d-be47-68fd20ed837d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:09.233194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 873/1723] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:08 2022] DELETE /identity/v3/projects/7d046780487b48a9b4103ad7dae31e96 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:09.236935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.237432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.237884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.257858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10efab-c30b-4f95-9bae-1a6b26044573 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.260631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] MFA Rules not processed for user `9ce69882676b4844a1feeb810a09760b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:09.262015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.334817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 874/1724] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:09.336065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.338069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.388859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:09.412418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.413816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.414249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.415519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.424398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.438456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc37f4-47ed-4a9d-b043-2500b17bab62 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.444339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055da85-5a30-492e-9b9e-2107659711f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.445354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055da85-5a30-492e-9b9e-2107659711f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.445950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055da85-5a30-492e-9b9e-2107659711f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.446420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055da85-5a30-492e-9b9e-2107659711f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.447646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055da85-5a30-492e-9b9e-2107659711f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.449939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055da85-5a30-492e-9b9e-2107659711f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.472615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 875/1725] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:09.475071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6570-5e0e-4824-942c-50bb92d59ed7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.475651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6570-5e0e-4824-942c-50bb92d59ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.476124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6570-5e0e-4824-942c-50bb92d59ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.477002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:09.504852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d1bb6570-5e0e-4824-942c-50bb92d59ed7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:09.511962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d1bb6570-5e0e-4824-942c-50bb92d59ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.557506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 876/1726] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:09.558982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29601091-9356-4f8d-a80b-7a3b753dace5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.559337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29601091-9356-4f8d-a80b-7a3b753dace5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.559703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29601091-9356-4f8d-a80b-7a3b753dace5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.561673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 877/1727] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jul 21 05:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:40:09.562507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29601091-9356-4f8d-a80b-7a3b753dace5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.578245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.584218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29601091-9356-4f8d-a80b-7a3b753dace5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.585842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40c50d-bc85-44a3-bfe1-f742265c50c0 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.589418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.590482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.590772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.591049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] PATH_INFO: `/v3/projects/af1d2db0f8254f81a8aa77f6f0c262db/users/d6d720f249be4e8780521c707676b589/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.599151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 851/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:09.601579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62875ea-1c58-4f3f-8dc3-8da6af636880 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.601874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62875ea-1c58-4f3f-8dc3-8da6af636880 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.602151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62875ea-1c58-4f3f-8dc3-8da6af636880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.621908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a62875ea-1c58-4f3f-8dc3-8da6af636880 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:09.623141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a62875ea-1c58-4f3f-8dc3-8da6af636880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.637958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 852/1729] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:09.638611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1d2db0f8254f81a8aa77f6f0c262db, user_id=d6d720f249be4e8780521c707676b589, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.639397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.639689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.639968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.641833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.670171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 878/1730] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:09 2022] PUT /identity/v3/projects/af1d2db0f8254f81a8aa77f6f0c262db/users/d6d720f249be4e8780521c707676b589/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:09.670171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.703184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:09.705413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.854579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38955-9c17-4cc1-a915-3ae07caff6e9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.862495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 853/1731] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:09.863514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.869335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.870558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.870969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.871402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.872424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:09.872935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.875059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.900380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a4625-4b25-4495-8b20-3e9efc048a18 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:09.909772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 879/1732] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:09.909772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.916790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:09.917565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:09.917855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:09.918130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:09.920038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:09.924767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:09.936510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:09.972877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 854/1733] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:09.974322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:09.983745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:10.016079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d051a1-5ae8-4c38-9aa0-a807567888e8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:10.036060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:10.036821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:10.037055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:10.037310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:10.068427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:10.070092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:10.158062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 855/1734] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:10.159102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:10.207257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4052504-f253-4ab1-b133-09bc2e8ff5c7 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:10.226667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:10.229793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:10.230457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:10.231496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:10.235661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:10.235661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:10.296603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd80b-0916-4934-96ac-a099f4e0be66 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:10.314973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:10.315099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 856/1735] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:10 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:10.315985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:10.318385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:10.320598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:10.321106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:10.325823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:10.426630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:10.502975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a94bd-22be-48d8-a2cc-a480f38cc04e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:10.518371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:10.519430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:10.520124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:10.520124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] PATH_INFO: `/v3/projects/af1d2db0f8254f81a8aa77f6f0c262db/users/d6d720f249be4e8780521c707676b589/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:10.523571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1d2db0f8254f81a8aa77f6f0c262db, user_id=d6d720f249be4e8780521c707676b589, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:10.529310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:10.549905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:10.575585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 857/1736] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:10 2022] PUT /identity/v3/projects/af1d2db0f8254f81a8aa77f6f0c262db/users/d6d720f249be4e8780521c707676b589/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:10.577499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:10.624590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:10.630124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1af41-6d73-4649-a06a-8662d9956ba3 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:10.680463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 880/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:10.695544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:10.695711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:10.704164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:10.790340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d5abd-9246-40de-8d13-a79a4149e276 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:10.794843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] MFA Rules not processed for user `d6d720f249be4e8780521c707676b589`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:10.796531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:10.823977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:10.832132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:10.832504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:10.839308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:10.844347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:10.855669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:10.956413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 858/1738] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:10 2022] POST /identity/v3/users => generated 287 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:10.958787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:11.012201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f037-fd5c-48e1-9e6c-7d82db46e09e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:11.041769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:11.042457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.042740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.043011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.043757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:11.053741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:11.071633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 881/1739] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:11.105715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:11.108758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 859/1740] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:11.147392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ac8c9-000d-4743-8768-bae8fcaf2522 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:11.148887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:11.151616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:11.175992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:11.179194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.179735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.180306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.182092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:11.185577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:11.236157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 882/1741] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:11.242135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:11.279153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e68d70-51bf-4b79-ae61-0a7b13ddda7e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:11.296891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a69d2-c6f8-403d-a8a4-99a69f20e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:11.298847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a69d2-c6f8-403d-a8a4-99a69f20e2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.299138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a69d2-c6f8-403d-a8a4-99a69f20e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.299454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a69d2-c6f8-403d-a8a4-99a69f20e2a7 admin admin] PATH_INFO: `/v3/projects/dda0dab4003d42f584e4ec9616cbe70c/users/edfa8388a114435caca5b44126a7f47f/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.359568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a69d2-c6f8-403d-a8a4-99a69f20e2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda0dab4003d42f584e4ec9616cbe70c, user_id=edfa8388a114435caca5b44126a7f47f, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:11.364518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a69d2-c6f8-403d-a8a4-99a69f20e2a7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:11.369811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26865224-729d-4b62-b72a-96659c4a5d7f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:11.387842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:11.388770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.389381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.389894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.412962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 883/1742] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:11 2022] PUT /identity/v3/projects/dda0dab4003d42f584e4ec9616cbe70c/users/edfa8388a114435caca5b44126a7f47f/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:11.419429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:11.422390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:11.427119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.427916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.428325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.472512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 860/1743] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:11.509167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] MFA Rules not processed for user `edfa8388a114435caca5b44126a7f47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:11.512737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:11.660459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:11.672731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3243e-9676-4471-9194-34f4d916481f service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:11.773142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 884/1744] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:11.777421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:11.784888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:11.836222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:11.837050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.837336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.837612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.842378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:11.896486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:11.914109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba360b-a801-4282-893e-cd4ad35b67f0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:11.927289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:11.928607 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0a91f-6cf5-4cbf-ab2a-abf5e4b66147 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:11.931513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:11.932410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.932924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.933757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.934572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:11.936656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:11.939085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 861/1745] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:11.940582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082a7f2-455b-44a3-a9a9-2e1d12eb4f57 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.940793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082a7f2-455b-44a3-a9a9-2e1d12eb4f57 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.941074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082a7f2-455b-44a3-a9a9-2e1d12eb4f57 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.947271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 862/1746] 10.222.0.18 () {54 vars in 961 bytes} [Thu Jul 21 05:40:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:40:11.948949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:11.949239 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:11.949518 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:11.971408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:11.972773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:12.004888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 885/1747] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:11 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:12.013474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.092935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 863/1748] 10.222.0.18 () {58 vars in 1058 bytes} [Thu Jul 21 05:40:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:12.101732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.141330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9540-c1f3-4002-a2c5-5e8c519e6ebe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.171544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf4817-0445-4804-8ffa-b705d61c558d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.190478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a8076-4b4b-4670-a66e-5434d79a8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.192524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a8076-4b4b-4670-a66e-5434d79a8afd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.193833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a8076-4b4b-4670-a66e-5434d79a8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.194148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a8076-4b4b-4670-a66e-5434d79a8afd admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.194863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a8076-4b4b-4670-a66e-5434d79a8afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.197193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a8076-4b4b-4670-a66e-5434d79a8afd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.252391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 886/1749] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:12 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:12.254405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcbf15-1217-4e55-b219-17464236f1a5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.254405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcbf15-1217-4e55-b219-17464236f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.254661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcbf15-1217-4e55-b219-17464236f1a5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.261518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 887/1750] 10.222.0.18 () {54 vars in 912 bytes} [Thu Jul 21 05:40:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:40:12.263101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcbf15-1217-4e55-b219-17464236f1a5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.300977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcbf15-1217-4e55-b219-17464236f1a5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.321632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573144-cef3-4310-b043-c6a9cab1ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.322216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573144-cef3-4310-b043-c6a9cab1ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.322498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573144-cef3-4310-b043-c6a9cab1ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.323050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573144-cef3-4310-b043-c6a9cab1ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.323805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c573144-cef3-4310-b043-c6a9cab1ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.328104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c573144-cef3-4310-b043-c6a9cab1ac77 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.360250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 888/1751] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:12.361695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.362011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.363669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.363911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.365230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.365622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.366073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.369771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:12.415213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.415596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:12.418085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.418196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:12.464153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 864/1752] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:12.466396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.491333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2e869-2f0c-4f7f-ac29-36954800ae59 service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.509808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.511691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.512151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.512659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] PATH_INFO: `/v3/projects/3a2c3a7faaea4e4daa7dbff148951e32/users/8ec4b7ffc2f541cd991386b834e3caf7/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.547047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2c3a7faaea4e4daa7dbff148951e32, user_id=8ec4b7ffc2f541cd991386b834e3caf7, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.555498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.611730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 865/1753] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:12 2022] PUT /identity/v3/projects/3a2c3a7faaea4e4daa7dbff148951e32/users/8ec4b7ffc2f541cd991386b834e3caf7/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:12.616013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.631844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 889/1754] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:12.668984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.670940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:12.690581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1f933-fb70-439e-868f-4dcf907a7a6e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.698112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:12.731563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:12.740983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdea2c-96bc-4f3b-8379-b5e5eed177bd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.759212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.766336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.766785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.767256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.769321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.772218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.809499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 866/1755] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:12.813404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.828236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11197097-c2be-4944-8c0f-41610ef58bb1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:12.830055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272afd55-73b6-417e-9a03-2a2573d7cc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.831690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272afd55-73b6-417e-9a03-2a2573d7cc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.831690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272afd55-73b6-417e-9a03-2a2573d7cc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.831820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272afd55-73b6-417e-9a03-2a2573d7cc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.843440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272afd55-73b6-417e-9a03-2a2573d7cc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.847250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272afd55-73b6-417e-9a03-2a2573d7cc6c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.858200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 890/1756] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:12.870818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:12.872560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.872852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.873132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] PATH_INFO: `/v3/projects/3a2c3a7faaea4e4daa7dbff148951e32/users/8ec4b7ffc2f541cd991386b834e3caf7/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.877064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2c3a7faaea4e4daa7dbff148951e32, user_id=8ec4b7ffc2f541cd991386b834e3caf7, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:12.879968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:12.899274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 867/1757] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:12 2022] PUT /identity/v3/projects/3a2c3a7faaea4e4daa7dbff148951e32/users/8ec4b7ffc2f541cd991386b834e3caf7/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:12.920363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:12.920865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:12.921287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:12.980303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] MFA Rules not processed for user `8ec4b7ffc2f541cd991386b834e3caf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:12.980417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:12.982341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:12.985317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:13.181123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff961c1-7ffb-4c4d-908a-3ed267b2056a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:13.187935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:13.189330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 891/1758] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:13.190287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:13.190903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:13.191218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] PATH_INFO: `/v3/users/94dafd9bde81460db8325c108fcf6c28` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:13.192590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dafd9bde81460db8325c108fcf6c28)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:13.194704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:13.203445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:13.208097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:13.308275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ddc6a-b5ce-49d7-b66a-18870f14beaa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:13.310061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dafd9bde81460db8325c108fcf6c28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:13.314149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:13.327542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:13.327990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:13.328295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:13.332938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dafd9bde81460db8325c108fcf6c28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:13.334609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dafd9bde81460db8325c108fcf6c28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:13.351706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dafd9bde81460db8325c108fcf6c28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:13.352892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a022a38c-f323-4e66-b2fe-a6df8dd1d4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dafd9bde81460db8325c108fcf6c28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:13.357704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:13.372104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:13.418028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 868/1759] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:12 2022] DELETE /identity/v3/users/94dafd9bde81460db8325c108fcf6c28 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:13.431025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eddab4-ae8a-47c1-a4e6-b963712fe8bf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:13.431250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eddab4-ae8a-47c1-a4e6-b963712fe8bf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:13.431537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eddab4-ae8a-47c1-a4e6-b963712fe8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:13.432695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 892/1760] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:13.485704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-82eddab4-ae8a-47c1-a4e6-b963712fe8bf None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:13.491840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-82eddab4-ae8a-47c1-a4e6-b963712fe8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:13.598354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:13.674569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 869/1761] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:13.686088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:13.832458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:13.849790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850acea2-a307-4e94-a56e-d01bd13ff32f service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:13.950322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:13.954487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:13.955953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:13.957701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:13.999018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:14.001012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:14.054813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 893/1762] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:14.942904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:14.943422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:14.943507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:14.981361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] MFA Rules not processed for user `a47f45eaf4f444f8a86530b856e69473`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:14.982643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:15.044324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:15.045804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:15.075332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37fdce-733b-4fc1-9e20-ba8f9ecbb827 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:15.091365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:15.093259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:15.094889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:15.095370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] PATH_INFO: `/v3/projects/4b7a79121df240eb9ed8142d24aa39f8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:15.098538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7a79121df240eb9ed8142d24aa39f8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:15.103684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:15.150088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 870/1763] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:15.217213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7a79121df240eb9ed8142d24aa39f8', 'request_id': 'req-3393ade6-5a19-41de-87cb-8cec346f236e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.252457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7a79121df240eb9ed8142d24aa39f8', 'request_id': 'req-3393ade6-5a19-41de-87cb-8cec346f236e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.305514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7a79121df240eb9ed8142d24aa39f8', 'request_id': 'req-3393ade6-5a19-41de-87cb-8cec346f236e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.334414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] The token cache is being invalidate because project 4b7a79121df240eb9ed8142d24aa39f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:15.336766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.339520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.348662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 894/1764] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:15 2022] DELETE /identity/v3/projects/4b7a79121df240eb9ed8142d24aa39f8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:15.350254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:15.373827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2fa0b-05e5-4b7b-ad0e-a079c104f67e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:15.576040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:15.578673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:15.580447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:15.580978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] PATH_INFO: `/v3/users/9ec923f7e3b14595a7cdf42a1b6665ca` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:15.583630 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec923f7e3b14595a7cdf42a1b6665ca)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:15.594993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:15.597535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:15.599972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:15.632027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393ade6-5a19-41de-87cb-8cec346f236e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:15.673480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:15.678950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:15.682312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:15.682599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] PATH_INFO: `/v3/users/edfa8388a114435caca5b44126a7f47f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:15.686334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfa8388a114435caca5b44126a7f47f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:15.691835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:15.771589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec923f7e3b14595a7cdf42a1b6665ca'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.806464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec923f7e3b14595a7cdf42a1b6665ca'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.807437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec923f7e3b14595a7cdf42a1b6665ca'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.842020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec923f7e3b14595a7cdf42a1b6665ca'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.843152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-876d1b05-705e-417a-8a8f-40b09ea531ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec923f7e3b14595a7cdf42a1b6665ca'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.907077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfa8388a114435caca5b44126a7f47f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.928591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 871/1765] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:15 2022] DELETE /identity/v3/users/9ec923f7e3b14595a7cdf42a1b6665ca => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:15.956413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfa8388a114435caca5b44126a7f47f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.957368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfa8388a114435caca5b44126a7f47f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:15.983644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfa8388a114435caca5b44126a7f47f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:16.013094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfa8388a114435caca5b44126a7f47f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:16.023721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:16.034532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 895/1766] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:15 2022] DELETE /identity/v3/users/edfa8388a114435caca5b44126a7f47f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:16.039964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d00ee-4ae6-4bd5-94ec-5df95e3d3b7e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:16.040517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d00ee-4ae6-4bd5-94ec-5df95e3d3b7e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:16.040517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d00ee-4ae6-4bd5-94ec-5df95e3d3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:16.047817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:16.085359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ef2d00ee-4ae6-4bd5-94ec-5df95e3d3b7e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:16.093158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ef2d00ee-4ae6-4bd5-94ec-5df95e3d3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:16.239525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 872/1767] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:16.268559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:16.270183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:16.356881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3eca4-1868-48f5-bf23-8084b6516c26 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:16.363034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:16.364264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:16.364806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:16.365218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:16.384983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:16.392329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:16.392682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:16.392915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:16.404062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:16.433125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 896/1768] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:16.499161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:16.500403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:16.636984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 873/1769] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:16.858925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:16.860574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:16.897156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27868d11-8459-45c7-a5e3-fbdb82b41874 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:16.919021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:16.922651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:16.923022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:16.933642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] PATH_INFO: `/v3/projects/43228db32ac54a40b9b502129fc9a05e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:16.944334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43228db32ac54a40b9b502129fc9a05e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:16.946707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:16.955331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:16.956814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:17.156635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43228db32ac54a40b9b502129fc9a05e', 'request_id': 'req-3996706f-08fd-487c-9841-2d4a1fecbd02'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.186293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43228db32ac54a40b9b502129fc9a05e', 'request_id': 'req-3996706f-08fd-487c-9841-2d4a1fecbd02'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.232146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43228db32ac54a40b9b502129fc9a05e', 'request_id': 'req-3996706f-08fd-487c-9841-2d4a1fecbd02'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.267914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] The token cache is being invalidate because project 43228db32ac54a40b9b502129fc9a05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:17.268960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.274301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3996706f-08fd-487c-9841-2d4a1fecbd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.279081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 897/1770] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:16 2022] DELETE /identity/v3/projects/43228db32ac54a40b9b502129fc9a05e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:17.284406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:17.284898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:17.285452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:17.319819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:17.326853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:17.339767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:17.379428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83e49-d4bf-4191-9561-72390bb39e65 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:17.647199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 898/1771] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:17.647199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:17.654386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:17.683361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d281ff-890f-4a06-b2db-efcc63525958 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:17.694590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:17.695495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:17.699441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:17.699799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] PATH_INFO: `/v3/projects/dda0dab4003d42f584e4ec9616cbe70c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:17.702598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda0dab4003d42f584e4ec9616cbe70c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:17.705235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:17.724778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:17.725538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:17.725982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:17.726278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:17.733922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:17.760848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:17.845018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda0dab4003d42f584e4ec9616cbe70c', 'request_id': 'req-83de4a97-4f69-4e1a-931d-0a77a99827f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.858729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda0dab4003d42f584e4ec9616cbe70c', 'request_id': 'req-83de4a97-4f69-4e1a-931d-0a77a99827f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.877170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda0dab4003d42f584e4ec9616cbe70c', 'request_id': 'req-83de4a97-4f69-4e1a-931d-0a77a99827f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.916838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:17.918600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] The token cache is being invalidate because project dda0dab4003d42f584e4ec9616cbe70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:17.918995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.920367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-83de4a97-4f69-4e1a-931d-0a77a99827f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:17.921469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:17.926413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 899/1772] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:17 2022] DELETE /identity/v3/projects/dda0dab4003d42f584e4ec9616cbe70c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:17.930671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:17.931759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:17.932449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:17.943243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 874/1773] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 988 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:40:17.944618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:17.965408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bbc01-649d-4bcb-86d5-422a3bc8c272 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:18.035345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:18.043375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:18.131482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:18.133450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:18.133798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:18.134097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] PATH_INFO: `/v3/users/8ec4b7ffc2f541cd991386b834e3caf7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:18.138270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec4b7ffc2f541cd991386b834e3caf7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:18.143774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:18.358745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:18.376126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec4b7ffc2f541cd991386b834e3caf7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:18.415436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec4b7ffc2f541cd991386b834e3caf7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:18.417413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec4b7ffc2f541cd991386b834e3caf7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:18.450537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 900/1774] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:18.453981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec4b7ffc2f541cd991386b834e3caf7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:18.455456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:18.457874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec4b7ffc2f541cd991386b834e3caf7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:18.501412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd2d6e-e83c-407d-9805-b15c93d0637e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:18.528539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:18.529543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:18.532333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:18.532926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:18.537397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:18.541428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:18.541603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 875/1775] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:17 2022] DELETE /identity/v3/users/8ec4b7ffc2f541cd991386b834e3caf7 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:18.543794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:18.573596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:18.575220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:18.589146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 901/1776] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:40:18.600116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:18.607846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:18.676575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dad7f4-1602-406c-b5aa-5fc50c0e9fab admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:18.863233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da294cf-7734-4402-958f-4799c1181508 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:18.884189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:18.886024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:18.888363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:18.889007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:18.890567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:18.890864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:18.891164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] PATH_INFO: `/v3/users/ab9a8ac4b190470fa49979ec2a5ed296` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:18.891318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:18.891908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:18.896731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9a8ac4b190470fa49979ec2a5ed296)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:18.902228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:18.907376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:18.991398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 902/1777] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:18 2022] POST /identity/v3/projects => generated 385 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:18.997615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:19.078980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:19.084673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9a8ac4b190470fa49979ec2a5ed296'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:19.107443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9a8ac4b190470fa49979ec2a5ed296'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:19.108136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9a8ac4b190470fa49979ec2a5ed296'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:19.141417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9a8ac4b190470fa49979ec2a5ed296'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:19.142900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-93784c83-0e33-4761-9bb6-d99fd6d49e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9a8ac4b190470fa49979ec2a5ed296'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:19.160298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96306372-54ad-4a5a-942f-72f5a00bb6df admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:19.174003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:19.175089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:19.175888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:19.176460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:19.178910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:19.183302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:19.213458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 876/1778] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:18 2022] DELETE /identity/v3/users/ab9a8ac4b190470fa49979ec2a5ed296 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:19.222559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:19.228998 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:19.229513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:19.248775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 903/1779] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:18 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:19.251257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:19.259666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:19.306192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:19.309852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:19.335807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5587b-29df-4a04-9810-580a21590248 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:19.451784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:19.561798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 877/1780] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:19.661055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:19.662059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:19.662059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:19.669563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:19.669897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:19.671552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:19.718180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:19.735916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 904/1781] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:19.745046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e0606-795f-4ea0-9959-3b3a7571fed4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:19.764850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:19.771962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:19.772777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:19.774276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:19.779600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:19.784593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:19.836418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:19.837655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 878/1782] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:19.855344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7396b3f-1766-48df-8c9c-f3009892c817 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:19.863864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66079875-84e2-4737-8952-59b89f892e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:19.864927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66079875-84e2-4737-8952-59b89f892e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:19.865206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66079875-84e2-4737-8952-59b89f892e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:19.865512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66079875-84e2-4737-8952-59b89f892e60 admin admin] PATH_INFO: `/v3/projects/346648e467034f68a5c91276905ae317/users/29dfffb3b37f4fd6b79182e0c6209e95/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:19.878638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:19.881473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:19.912158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66079875-84e2-4737-8952-59b89f892e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346648e467034f68a5c91276905ae317, user_id=29dfffb3b37f4fd6b79182e0c6209e95, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:19.915693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66079875-84e2-4737-8952-59b89f892e60 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:19.942639 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 905/1783] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:19 2022] PUT /identity/v3/projects/346648e467034f68a5c91276905ae317/users/29dfffb3b37f4fd6b79182e0c6209e95/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:19.955665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec721-857a-41bf-b840-9f5b97bf80c1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:19.955665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec721-857a-41bf-b840-9f5b97bf80c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:19.955665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec721-857a-41bf-b840-9f5b97bf80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:20.027344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c80ec721-857a-41bf-b840-9f5b97bf80c1 None None] MFA Rules not processed for user `29dfffb3b37f4fd6b79182e0c6209e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:20.031451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c80ec721-857a-41bf-b840-9f5b97bf80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:20.096218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08621984-b38c-4cbb-acbe-7946c45fffec admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:20.247657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 906/1784] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:20.252194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:20.254714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:20.257547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:20.286789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:20.291079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:20.291386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:20.294369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:20.336297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:20.339133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:20.358000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 907/1785] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jul 21 05:40:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:20.359338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:20.390341 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:20.506130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:20.509478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:20.542680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 879/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:20.545074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:20.550219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:20.577671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd2111-be03-48d4-8588-b9a64070a4bd service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:20.589419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:20.592211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:20.592626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:20.593421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:20.605860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2a85-fb5a-4726-a9ef-c59e20094946 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:20.610764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:20.613860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:20.620298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:20.621126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:20.621494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:20.621972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:20.622821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:20.627465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:20.637977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 880/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:20.647759 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:20.651673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:20.682539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b965e6-d71d-4197-abdb-679f8e0e0757 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:20.704799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 908/1788] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:20 2022] POST /identity/v3/projects => generated 387 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:20.708052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:20.710405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:20.714581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:20.715342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:20.717218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] PATH_INFO: `/v3/projects/3a2c3a7faaea4e4daa7dbff148951e32` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:20.719565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2c3a7faaea4e4daa7dbff148951e32)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:20.728913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:20.787265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:20.854980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2c3a7faaea4e4daa7dbff148951e32', 'request_id': 'req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:20.882410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2c3a7faaea4e4daa7dbff148951e32', 'request_id': 'req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:20.903580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b5ae-9f33-4676-86c8-7c89c7997962 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:20.913234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2c3a7faaea4e4daa7dbff148951e32', 'request_id': 'req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:20.958103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] The token cache is being invalidate because project 3a2c3a7faaea4e4daa7dbff148951e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:20.967467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:20.972957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a9b3ebc4-7208-4df3-9b78-b84380ec81fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:20.979523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 881/1789] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:20 2022] DELETE /identity/v3/projects/3a2c3a7faaea4e4daa7dbff148951e32 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:20.981501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1bc5-ad0d-4eb0-b563-268df0c23c60 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:20.981799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1bc5-ad0d-4eb0-b563-268df0c23c60 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:20.982086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1bc5-ad0d-4eb0-b563-268df0c23c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.060976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-640f1bc5-ad0d-4eb0-b563-268df0c23c60 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:21.064654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-640f1bc5-ad0d-4eb0-b563-268df0c23c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:21.142399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:21.143654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.143654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.143654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.153591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:21.160150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:21.274922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 909/1790] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:20 2022] POST /identity/v3/users => generated 294 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:21.278181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:21.288053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:21.318980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8302-f5ef-43ac-9061-e8e59a74231c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:21.335795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:21.336512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.336801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.337257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.338159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:21.339940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:21.375309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 910/1791] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:21.381674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:21.395687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 882/1792] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:21.414593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.414888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.415175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.418288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155045-66ad-45f4-a9e4-35d34f3f7a1e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:21.445958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:21.447099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.447545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.447966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.448912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:21.450727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:21.484422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:21.487454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:21.502234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 911/1793] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:21.503209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:21.514012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 883/1794] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:21.519109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:21.547163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8bf49-61dc-4934-9c0d-ed4014c73774 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:21.554839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6713c9-415e-4bdb-bef7-91baebf3f623 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:21.565256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb346a-059c-45ca-b6ca-4004a44252a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:21.566191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb346a-059c-45ca-b6ca-4004a44252a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.573587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb346a-059c-45ca-b6ca-4004a44252a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.574137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb346a-059c-45ca-b6ca-4004a44252a7 admin admin] PATH_INFO: `/v3/projects/33a7351d0d0e452dbf839e2ad270006d/users/b480ea14b4814ea9b39d96c1f2e4a91c/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.577669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:21.578386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.578669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.578945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.579456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:21.579689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:21.580003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:21.581677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:21.626127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 884/1795] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:21.630115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:21.631524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb346a-059c-45ca-b6ca-4004a44252a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a7351d0d0e452dbf839e2ad270006d, user_id=b480ea14b4814ea9b39d96c1f2e4a91c, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:21.634300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb346a-059c-45ca-b6ca-4004a44252a7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:21.665384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 912/1796] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:21 2022] PUT /identity/v3/projects/33a7351d0d0e452dbf839e2ad270006d/users/b480ea14b4814ea9b39d96c1f2e4a91c/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:21.669600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8114aa-c1ef-4aba-9147-f4128260e1e3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:21.679650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.681081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.681621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.762890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] MFA Rules not processed for user `b480ea14b4814ea9b39d96c1f2e4a91c`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:21.767549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:21.873280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:21.875617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:21.879818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:21.880669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:21.881876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:21.890567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:21.966489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 885/1797] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:21 2022] POST /identity/v3/projects => generated 369 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:21.969247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.007675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:22.044857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 913/1798] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:22.045998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.082794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25695-60be-4b17-89db-1c0e14a68c04 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.188676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a87381-2ff0-482b-8e3a-061f3f45a5a0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.227686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.229294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.231302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.232464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.235954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.238283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.297450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.298222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.298683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.299181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.300243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.305673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.345435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 886/1799] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:21 2022] POST /identity/v3/users => generated 285 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:22.350013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.381422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 914/1800] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:22 2022] POST /identity/v3/projects => generated 387 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:22.382799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.429648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a6622-42eb-419b-8cf8-70e176a235c1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.569080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ec8c4-5b03-4572-b3cc-a41b6d422aaf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.570600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:22.578677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.580205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.581010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.581816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.583132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.586963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.622531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.624559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.624972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.625349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.626733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.627147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 915/1801] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:22 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:22.630599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.631839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.646804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 887/1802] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:22.651394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.656011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210513f-f91a-44eb-b8c5-8c8238921007 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.667601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc592c-7496-44ab-a9cb-f74f7a4e5fe9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.671331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.672461 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.673073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.673591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.674490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.675096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.676046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.676519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.676915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.678354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.679203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.680442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.702730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 888/1803] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:22.706453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 916/1804] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:22.708168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.710483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.745433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccd74d-045a-4a8f-b384-4cf46c2b14c2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.746523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa8ea7-de6e-46ae-95c6-cd8193782458 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:22.755904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.757451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.757929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.758770 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] PATH_INFO: `/v3/projects/fdbccfd0cb7541cc8dd0f37b68b42397/users/71c0bdda097a4e2c98fc8e7f6702c73c/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.771509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e4316-42f3-4575-a46c-8629e28cdd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:22.772736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4316-42f3-4575-a46c-8629e28cdd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.772927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4316-42f3-4575-a46c-8629e28cdd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.773316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e4316-42f3-4575-a46c-8629e28cdd03 admin admin] PATH_INFO: `/v3/projects/ed0464869ad84dcd88f5e89a1d760a4a/users/481e64c7c8ad4c9685eff10aa334f5a4/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.804317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4316-42f3-4575-a46c-8629e28cdd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0464869ad84dcd88f5e89a1d760a4a, user_id=481e64c7c8ad4c9685eff10aa334f5a4, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.809170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e4316-42f3-4575-a46c-8629e28cdd03 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.825430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbccfd0cb7541cc8dd0f37b68b42397, user_id=71c0bdda097a4e2c98fc8e7f6702c73c, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:22.831442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:22.843687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 889/1805] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:22 2022] PUT /identity/v3/projects/ed0464869ad84dcd88f5e89a1d760a4a/users/481e64c7c8ad4c9685eff10aa334f5a4/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:22.846670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:22.847450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:22.847723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:22.866530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 917/1806] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:22 2022] PUT /identity/v3/projects/fdbccfd0cb7541cc8dd0f37b68b42397/users/71c0bdda097a4e2c98fc8e7f6702c73c/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:22.869604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:22.918569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] MFA Rules not processed for user `481e64c7c8ad4c9685eff10aa334f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:22.921092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:23.066765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e05e-7854-4cfe-8c72-dbe538021e18 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.068980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:23.084051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.085189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.086687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.087023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.087806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.093988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.122175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 890/1807] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:23.122522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 918/1808] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:23.124692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.126421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.160099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538f08a-60d0-4ba2-bd5f-cbfa00fa3f42 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.166524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072a7a5-12d5-4d6d-b62b-645f57f80b63 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.171906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.173965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.174374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.174569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.175229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.177197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.180992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d6b3-9c59-4d72-aa7e-5e405d48116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.182994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d6b3-9c59-4d72-aa7e-5e405d48116d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.182994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d6b3-9c59-4d72-aa7e-5e405d48116d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.182994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d6b3-9c59-4d72-aa7e-5e405d48116d admin admin] PATH_INFO: `/v3/projects/fdbccfd0cb7541cc8dd0f37b68b42397/users/71c0bdda097a4e2c98fc8e7f6702c73c/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.187296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d6b3-9c59-4d72-aa7e-5e405d48116d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbccfd0cb7541cc8dd0f37b68b42397, user_id=71c0bdda097a4e2c98fc8e7f6702c73c, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.191155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d6b3-9c59-4d72-aa7e-5e405d48116d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.219587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 919/1809] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:23 2022] PUT /identity/v3/projects/fdbccfd0cb7541cc8dd0f37b68b42397/users/71c0bdda097a4e2c98fc8e7f6702c73c/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:23.232078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.233455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.236349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.259024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 891/1810] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:23 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:23.261242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.362942 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] MFA Rules not processed for user `71c0bdda097a4e2c98fc8e7f6702c73c`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:23.366537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:23.510151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a545a1-5d70-43be-bd6f-b67f68f35abc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.525326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.526045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.526332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.526613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.527380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.529586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.595717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 892/1811] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:23 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:23.596783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.606873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 920/1812] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:23.614511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1ad07-ee4a-4a5f-ab9e-6c88f26b9611 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.619752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.621064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:23.631394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.632190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.632647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.632938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.633737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.635338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.659249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 893/1813] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:23.666579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:23.666813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.690705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4f182-ec27-4aee-98de-534dc27798a6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.709878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.711095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.711375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.711652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] PATH_INFO: `/v3/projects/c565460e5d684d77a2a2011d1ffd87e3/users/1a3fc14d24264242ae1e47465c86cc30/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.740766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6478fa-655c-40db-b48a-7de6e96a52d8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.747362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.748362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.748804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.749119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.759547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c565460e5d684d77a2a2011d1ffd87e3, user_id=1a3fc14d24264242ae1e47465c86cc30, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.763837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.765381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.767996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:23.791777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 921/1814] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:23.808699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 894/1815] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:23 2022] PUT /identity/v3/projects/c565460e5d684d77a2a2011d1ffd87e3/users/1a3fc14d24264242ae1e47465c86cc30/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:23.813908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:23.827148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf68a9-0f1b-4a51-810d-74d2eba9c8b6 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:23.974380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647124-64ec-4f3c-8cc6-244eff744928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:23.975197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647124-64ec-4f3c-8cc6-244eff744928 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:23.978973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647124-64ec-4f3c-8cc6-244eff744928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:23.979265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647124-64ec-4f3c-8cc6-244eff744928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:23.987071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8647124-64ec-4f3c-8cc6-244eff744928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:23.993971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8647124-64ec-4f3c-8cc6-244eff744928 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:24.054701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:24.056989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 922/1816] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:24.074059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af79d-036d-4654-8e3b-a6c17a669d95 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:24.090406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d462d11-927b-488c-a9b5-c566d0931e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:24.091450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d462d11-927b-488c-a9b5-c566d0931e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:24.091734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d462d11-927b-488c-a9b5-c566d0931e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:24.092057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d462d11-927b-488c-a9b5-c566d0931e01 admin admin] PATH_INFO: `/v3/projects/c565460e5d684d77a2a2011d1ffd87e3/users/1a3fc14d24264242ae1e47465c86cc30/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:24.095049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d462d11-927b-488c-a9b5-c566d0931e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c565460e5d684d77a2a2011d1ffd87e3, user_id=1a3fc14d24264242ae1e47465c86cc30, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:24.103931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d462d11-927b-488c-a9b5-c566d0931e01 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:24.159825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:24.160518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:24.161223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:24.165814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 895/1817] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:24 2022] PUT /identity/v3/projects/c565460e5d684d77a2a2011d1ffd87e3/users/1a3fc14d24264242ae1e47465c86cc30/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:24.178749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5683-75f9-40a0-bdb8-cbd1bee53ead None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:24.179114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5683-75f9-40a0-bdb8-cbd1bee53ead None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:24.187125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5683-75f9-40a0-bdb8-cbd1bee53ead None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:24.195357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 896/1818] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:40:24 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:40:24.237628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] MFA Rules not processed for user `1a3fc14d24264242ae1e47465c86cc30`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:24.239038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:24.478624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 923/1819] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:24.494297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:24.494617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:24.495024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:24.514154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:24.515700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:24.543793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:24.550261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:24.626890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:24.662611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018ba19-c554-4161-b7b8-4b662beb5125 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:24.674215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:24.674837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:24.675137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:24.675430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:24.690875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:24.692383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:24.732562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 924/1820] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:24.733614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:24.741383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:24.790594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 897/1821] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:40:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:24.875736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:24.878949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:24.904392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:24.934032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0a477-65ed-400e-8d6b-1aa6ecca329e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:24.959563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:24.960275 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:24.960570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:24.964635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:24.982511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee4fa-bf9a-41fc-b60f-f6a3028fcf13 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:25.001304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:25.006874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:25.006874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:25.006874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] PATH_INFO: `/v3/projects/e2be1f0c5365430b9adbfb142380de81` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:25.007238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:25.008437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2be1f0c5365430b9adbfb142380de81)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:25.014058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:25.016132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:25.079320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 898/1822] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:25.199204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2be1f0c5365430b9adbfb142380de81', 'request_id': 'req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.228579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2be1f0c5365430b9adbfb142380de81', 'request_id': 'req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.285214 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2be1f0c5365430b9adbfb142380de81', 'request_id': 'req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.329160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] The token cache is being invalidate because project e2be1f0c5365430b9adbfb142380de81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:25.329732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.332394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.344070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 925/1823] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:24 2022] DELETE /identity/v3/projects/e2be1f0c5365430b9adbfb142380de81 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:25.348107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:25.376606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2031b47-d326-4185-93f6-16b6d3ff87ea service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:25.637464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:25.638395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:25.638674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:25.638940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] PATH_INFO: `/v3/users/dede37d4005040c18b79d00eef610ee5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:25.649847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dede37d4005040c18b79d00eef610ee5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:25.656023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:25.768704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dede37d4005040c18b79d00eef610ee5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.788317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dede37d4005040c18b79d00eef610ee5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.800532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dede37d4005040c18b79d00eef610ee5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.811305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dede37d4005040c18b79d00eef610ee5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.812408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7aa10dbe-2401-41a4-9007-480897f34a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dede37d4005040c18b79d00eef610ee5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:25.837452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 899/1824] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:25 2022] DELETE /identity/v3/users/dede37d4005040c18b79d00eef610ee5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:26.137772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:26.139708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:26.280861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a3c2f-fe4e-4795-b255-1d20fa7fb190 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:26.370816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:26.420162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:26.421303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:26.421811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:26.422304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:26.426053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:26.576460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:26.579477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb37bfc-bf82-4ebd-b0c7-65883afb447f service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:26.614697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 926/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:27.287763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0506f12-f9fb-40b9-820e-6a6f4e1d87fb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:27.289576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0506f12-f9fb-40b9-820e-6a6f4e1d87fb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:27.290149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0506f12-f9fb-40b9-820e-6a6f4e1d87fb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:27.293920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 900/1826] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:40:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:40:27.334880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:27.335752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:27.336204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:27.389715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:27.390994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:27.661927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 927/1827] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:28.461042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0506f12-f9fb-40b9-820e-6a6f4e1d87fb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:28.466253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b0506f12-f9fb-40b9-820e-6a6f4e1d87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:28.508310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0506f12-f9fb-40b9-820e-6a6f4e1d87fb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:28.524137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0939-bfc7-4f99-bef7-c821c391bd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:28.532314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0939-bfc7-4f99-bef7-c821c391bd89 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:28.533022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0939-bfc7-4f99-bef7-c821c391bd89 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:28.533806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0939-bfc7-4f99-bef7-c821c391bd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:28.549544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c0939-bfc7-4f99-bef7-c821c391bd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:28.553927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c0939-bfc7-4f99-bef7-c821c391bd89 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:28.573649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 901/1828] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:28.986634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:28.988839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:29.129778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a813096-d649-4ac2-be5c-f3103b347570 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:29.136208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:29.137954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:29.138610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:29.139438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] PATH_INFO: `/v3/projects/be33c07f52964765ada5166c387d3dcf` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:29.141785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be33c07f52964765ada5166c387d3dcf)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:29.147156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:29.217010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:29.288409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be33c07f52964765ada5166c387d3dcf', 'request_id': 'req-c8e305ae-fc62-4c6a-8671-9f040a405174'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:29.316237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be33c07f52964765ada5166c387d3dcf', 'request_id': 'req-c8e305ae-fc62-4c6a-8671-9f040a405174'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:29.336370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be33c07f52964765ada5166c387d3dcf', 'request_id': 'req-c8e305ae-fc62-4c6a-8671-9f040a405174'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:29.392672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] The token cache is being invalidate because project be33c07f52964765ada5166c387d3dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:29.392994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:29.394030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c8e305ae-fc62-4c6a-8671-9f040a405174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:29.397548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 928/1829] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:28 2022] DELETE /identity/v3/projects/be33c07f52964765ada5166c387d3dcf => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:29.402781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:29.403279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:29.416288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:29.486368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:29.489494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:29.652124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:29.696498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 902/1830] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:29.703699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:29.704055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:29.704344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:29.748093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:29.752216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:29.783572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 929/1831] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:29.788173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:29.815717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2cc58-c9f7-494d-afba-1e956ede32a7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:29.833267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:29.834208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:29.834647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:29.835039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:29.835980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:29.836589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:29.838414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:29.870925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 903/1832] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:29.875138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:29.887131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003abf3-de55-4b32-8545-51981efaec62 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:29.901947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:29.903962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:29.905936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:29.907103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:29.909266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:29.915969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:29.982145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 930/1833] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:29 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:29.986441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:30.003500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8832ea-f979-4bef-ab33-7cbf7380cc18 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:30.143721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:30.146678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.150103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.151526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.153361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:30.161408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:30.204258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 904/1834] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:29 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:30.208949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:30.233241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd25d6-58f0-49a2-973c-07ae6fd0e883 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:30.241818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:30.242769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.243053 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.243324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.244155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:30.246153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:30.272035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 931/1835] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:30.275965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:30.298758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ceff4-74db-403c-a77f-90ec9282d5d1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:30.302680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:30.305164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:30.330453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:30.331225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.331516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.331833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.332755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:30.348700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:30.352068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bcebe-6dcc-4fa8-bf8f-d9b3a49f0b07 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:30.372282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 905/1836] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:30.373040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:30.373531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:30.389484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec237c-a744-4f96-9bbf-9f0c2bd42ccc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:30.398739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.401969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.404495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] PATH_INFO: `/v3/users/481e64c7c8ad4c9685eff10aa334f5a4` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.415020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481e64c7c8ad4c9685eff10aa334f5a4)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:30.421921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a2fdb-5776-4cbf-ab33-001aa914e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:30.425407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a2fdb-5776-4cbf-ab33-001aa914e102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.428535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a2fdb-5776-4cbf-ab33-001aa914e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.428691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:30.433085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a2fdb-5776-4cbf-ab33-001aa914e102 admin admin] PATH_INFO: `/v3/projects/978b747d34d341e3bfc64923669991a7/users/f0a348743b6146d39d4266e3670ad731/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.483006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a2fdb-5776-4cbf-ab33-001aa914e102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978b747d34d341e3bfc64923669991a7, user_id=f0a348743b6146d39d4266e3670ad731, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:30.487400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a2fdb-5776-4cbf-ab33-001aa914e102 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:30.564438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 906/1837] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:30 2022] PUT /identity/v3/projects/978b747d34d341e3bfc64923669991a7/users/f0a348743b6146d39d4266e3670ad731/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:30.568403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.568737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.569036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.616293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481e64c7c8ad4c9685eff10aa334f5a4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:30.635244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] MFA Rules not processed for user `f0a348743b6146d39d4266e3670ad731`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:30.636582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:30.652797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481e64c7c8ad4c9685eff10aa334f5a4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:30.654014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481e64c7c8ad4c9685eff10aa334f5a4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:30.670168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481e64c7c8ad4c9685eff10aa334f5a4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:30.718569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88104f48-f4d5-453f-a5fc-c73f81c9ed19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481e64c7c8ad4c9685eff10aa334f5a4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:30.739625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 932/1838] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:30 2022] DELETE /identity/v3/users/481e64c7c8ad4c9685eff10aa334f5a4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:30.744920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:30.745300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:30.745678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:30.793741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 907/1839] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:30.801822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:30.803351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:30.811199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:30.813754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:30.916654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:30.978252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:30.996790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f7703-08f4-405c-a874-558dbfb8f7ff None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.056738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 933/1840] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:31.066244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.068683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:31.141847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.142536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.142815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.143089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.143789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.145722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.178632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4db705-7d14-49ef-a234-ed27606683d0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.190494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.191623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.192123 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.192765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.214855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 908/1841] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:30 2022] POST /identity/v3/projects => generated 379 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:31.217333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.223006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.228271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.246490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 934/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:31.350737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958bf3-a4c8-4458-8fd2-e7a131056c6a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.366326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.367187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.367273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.368734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.369362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.373509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.437677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 909/1843] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:31 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:31.441677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.461087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aaa9a-8069-488d-a6a8-8d5481a23ebd service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.468319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.469169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.469361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.469735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.470583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.472388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.490040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 935/1844] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:31.494146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.522488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9dde3-fdee-4701-9b6a-3bfcff6e34f1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.541387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.542872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.543230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.543474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] PATH_INFO: `/v3/projects/8a5606e8708d455eb43594d637185a81/users/323a6bd14e5f450fa803f02c484e95f6/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.569489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5606e8708d455eb43594d637185a81, user_id=323a6bd14e5f450fa803f02c484e95f6, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.574123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.597670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 910/1845] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:31 2022] PUT /identity/v3/projects/8a5606e8708d455eb43594d637185a81/users/323a6bd14e5f450fa803f02c484e95f6/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:31.602603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.621642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56423bbf-a078-4097-b83c-46542a038713 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.703268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9cc6-f924-44d5-aef2-54a24c4e3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.703972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9cc6-f924-44d5-aef2-54a24c4e3b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.704291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9cc6-f924-44d5-aef2-54a24c4e3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.704608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9cc6-f924-44d5-aef2-54a24c4e3b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.705347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9cc6-f924-44d5-aef2-54a24c4e3b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.707095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9cc6-f924-44d5-aef2-54a24c4e3b72 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.719165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 936/1846] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:31.723440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.734292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738b854-17a2-41e3-b3fd-a3a132ce0d13 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.739445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.741119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.741119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.741314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] PATH_INFO: `/v3/projects/8a5606e8708d455eb43594d637185a81/users/323a6bd14e5f450fa803f02c484e95f6/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.743429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5606e8708d455eb43594d637185a81, user_id=323a6bd14e5f450fa803f02c484e95f6, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.746375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.758418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 911/1847] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:31 2022] PUT /identity/v3/projects/8a5606e8708d455eb43594d637185a81/users/323a6bd14e5f450fa803f02c484e95f6/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:31.768430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.768749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.769030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.802162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.804298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:31.816014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] MFA Rules not processed for user `323a6bd14e5f450fa803f02c484e95f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:31.821467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:31.825685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:31.901970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:31.909119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940eb1a-710d-4b41-bb2a-57de53a668de admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.911935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 937/1848] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:31.914194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.915069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.915344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.915610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] PATH_INFO: `/v3/projects/ed0464869ad84dcd88f5e89a1d760a4a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.916207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:31.917123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0464869ad84dcd88f5e89a1d760a4a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.917560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:31.919324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.931248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015e18d-3902-4047-b28d-02ff596050fb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:31.935970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:31.936912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:31.937198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:31.937536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] PATH_INFO: `/v3/users/7ee50cc99d5144e9951d234000d5acf0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:31.938879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee50cc99d5144e9951d234000d5acf0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:31.940931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:31.969968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0464869ad84dcd88f5e89a1d760a4a', 'request_id': 'req-bfc70439-a837-4999-b9bd-04faf896156a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:31.978260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0464869ad84dcd88f5e89a1d760a4a', 'request_id': 'req-bfc70439-a837-4999-b9bd-04faf896156a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:31.985885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0464869ad84dcd88f5e89a1d760a4a', 'request_id': 'req-bfc70439-a837-4999-b9bd-04faf896156a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:31.990602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee50cc99d5144e9951d234000d5acf0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:31.997813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] The token cache is being invalidate because project ed0464869ad84dcd88f5e89a1d760a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:31.998269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:31.998886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.000836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 912/1849] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:31 2022] DELETE /identity/v3/projects/ed0464869ad84dcd88f5e89a1d760a4a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:32.004114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee50cc99d5144e9951d234000d5acf0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.004749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:32.004865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee50cc99d5144e9951d234000d5acf0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.007222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.014386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee50cc99d5144e9951d234000d5acf0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.022035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6a92736b-37f5-4957-b2c9-ddcb306cc3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee50cc99d5144e9951d234000d5acf0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.032340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 938/1850] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:31 2022] DELETE /identity/v3/users/7ee50cc99d5144e9951d234000d5acf0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:32.034093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.034717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.035094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.055996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:32.057420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.094148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc70439-a837-4999-b9bd-04faf896156a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:32.148264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 939/1851] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:32.155371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:32.159168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.188686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:32.213864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:32.214952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.215381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.215937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] PATH_INFO: `/v3/users/1a3fc14d24264242ae1e47465c86cc30` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.217467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3fc14d24264242ae1e47465c86cc30)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:32.219516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:32.254091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4646095-7e97-4134-bd0f-17699dc4c66c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:32.258213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:32.259049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.259330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.259600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.273102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:32.274791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:32.279218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3fc14d24264242ae1e47465c86cc30'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.287802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 940/1852] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:32.289438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3fc14d24264242ae1e47465c86cc30'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.290145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3fc14d24264242ae1e47465c86cc30'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.298513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3fc14d24264242ae1e47465c86cc30'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.299244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3fc14d24264242ae1e47465c86cc30'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.317482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 913/1853] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:32 2022] DELETE /identity/v3/users/1a3fc14d24264242ae1e47465c86cc30 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:32.350810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:32.352393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.368207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:32.432683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11cab-e5d5-4192-95ec-b391b4194eac service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:32.501843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:32.502717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.503001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.503275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.505179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.586489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:32.587952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:32.598067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 941/1854] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:32.684735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:32.686402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.697781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:32.699223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.793353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def86f5-a950-44df-b3e2-c178f2a838fc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:32.798198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:32.799079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.799357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.800695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] PATH_INFO: `/v3/projects/0130268bbf8c4872a1c04ed65934e6a8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.801919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0130268bbf8c4872a1c04ed65934e6a8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:32.804031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:32.809112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23ee69-fe7e-4ece-81f1-3989180432f6 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:32.821225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:32.822507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.824817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.825689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] PATH_INFO: `/v3/projects/c565460e5d684d77a2a2011d1ffd87e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.827544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c565460e5d684d77a2a2011d1ffd87e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:32.830648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:32.860046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:32.862683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0130268bbf8c4872a1c04ed65934e6a8', 'request_id': 'req-455413c2-830b-4edb-b1ae-d5af661ad303'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.872989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0130268bbf8c4872a1c04ed65934e6a8', 'request_id': 'req-455413c2-830b-4edb-b1ae-d5af661ad303'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.881774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0130268bbf8c4872a1c04ed65934e6a8', 'request_id': 'req-455413c2-830b-4edb-b1ae-d5af661ad303'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.892277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:32.893839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c565460e5d684d77a2a2011d1ffd87e3', 'request_id': 'req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.909232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] The token cache is being invalidate because project 0130268bbf8c4872a1c04ed65934e6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:32.911765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.914278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.916113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c565460e5d684d77a2a2011d1ffd87e3', 'request_id': 'req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.920260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 914/1855] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:32 2022] DELETE /identity/v3/projects/0130268bbf8c4872a1c04ed65934e6a8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:32.921461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:32.923289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:32.949528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c565460e5d684d77a2a2011d1ffd87e3', 'request_id': 'req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.956898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] The token cache is being invalidate because project c565460e5d684d77a2a2011d1ffd87e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:32.957146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.957804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46614c1b-cfa2-4e71-b8a7-dca6fad6207f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:32.959752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 942/1856] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:32 2022] DELETE /identity/v3/projects/c565460e5d684d77a2a2011d1ffd87e3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:32.966860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efae93-be7b-48c5-ac29-07b206936f6d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:32.967233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efae93-be7b-48c5-ac29-07b206936f6d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:32.968130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efae93-be7b-48c5-ac29-07b206936f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:32.991937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a5efae93-be7b-48c5-ac29-07b206936f6d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:32.993367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a5efae93-be7b-48c5-ac29-07b206936f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.013372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455413c2-830b-4edb-b1ae-d5af661ad303 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.074786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 943/1857] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:33.082867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.083156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.083429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.085656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.086161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.086447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.086725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] PATH_INFO: `/v3/users/eb48922c9214416f9c6259b1ae067d39` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.088170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb48922c9214416f9c6259b1ae067d39)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.090444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.103643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:33.105285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.114632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 944/1858] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:33.120775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.131560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c56757-4a3f-443f-929d-eba47b3f8736 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.136608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.137352 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.137698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.138039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.139019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:33.139196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.140943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.147296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb48922c9214416f9c6259b1ae067d39'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.153840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 945/1859] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:33.157428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb48922c9214416f9c6259b1ae067d39'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.158104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb48922c9214416f9c6259b1ae067d39'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.158234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.166583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb48922c9214416f9c6259b1ae067d39'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.167469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb48922c9214416f9c6259b1ae067d39'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.169130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd86a60-16d7-4717-93fe-96b68ff8a5f0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.179196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.179884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.180162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.180425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.181153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.183122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.189014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 915/1860] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:32 2022] DELETE /identity/v3/users/eb48922c9214416f9c6259b1ae067d39 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:33.217287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 946/1861] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/projects => generated 407 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:33.223317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.225910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.269922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:33.325480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d279a-de1e-4f7f-9c18-135095078891 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.392685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.392685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.393082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.393426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.394205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.396249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.439577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 916/1862] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/users => generated 304 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:33.442725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.459572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df422dc9-1193-4148-b588-26bad9c88df9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.466680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.467626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.467972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.468452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.469592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.471694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.488706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 947/1863] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:33.492900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.507362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0042d-3685-417c-91e5-abe83029225b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.512266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251687a-50fd-4488-93cc-ed74998c30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.512976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251687a-50fd-4488-93cc-ed74998c30a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.513257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251687a-50fd-4488-93cc-ed74998c30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.513535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251687a-50fd-4488-93cc-ed74998c30a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.514335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251687a-50fd-4488-93cc-ed74998c30a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.516002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251687a-50fd-4488-93cc-ed74998c30a5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.526605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 917/1864] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:33.530964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.542379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a65e27-eab0-4fd5-9b65-8b4a0d665aa0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.547501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.548460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.548830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.549199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] PATH_INFO: `/v3/projects/d6c7a6807cc442e0a356753f52d4af70/users/3ebd845b9aa84d18b5a252175e6ce799/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.565246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c7a6807cc442e0a356753f52d4af70, user_id=3ebd845b9aa84d18b5a252175e6ce799, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.568002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.580559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 948/1865] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:33 2022] PUT /identity/v3/projects/d6c7a6807cc442e0a356753f52d4af70/users/3ebd845b9aa84d18b5a252175e6ce799/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:33.592149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.592601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.592885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.593157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.594364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.626733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] MFA Rules not processed for user `3ebd845b9aa84d18b5a252175e6ce799`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:33.628638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.643436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:33.675072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12658832-2f03-4a75-a758-3ff21091ed11 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.684430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.685575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.685957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.686369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] PATH_INFO: `/v3/projects/0406dd20f3544c3d86311ca74beed3e6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.688044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0406dd20f3544c3d86311ca74beed3e6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.690256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.704825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 918/1866] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:33.709865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.731590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb146c3e-e524-4489-bcdb-60a944848eff None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.746263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0406dd20f3544c3d86311ca74beed3e6', 'request_id': 'req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.753724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0406dd20f3544c3d86311ca74beed3e6', 'request_id': 'req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.763876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0406dd20f3544c3d86311ca74beed3e6', 'request_id': 'req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.772199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:33.777428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] The token cache is being invalidate because project 0406dd20f3544c3d86311ca74beed3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:33.777750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.778545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-621d4951-4dac-41f7-aa1c-6c4efee1d3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:33.780128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 949/1867] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:33 2022] DELETE /identity/v3/projects/0406dd20f3544c3d86311ca74beed3e6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:33.785201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cf332-3d65-4627-9537-e91c093670ec None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.785480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cf332-3d65-4627-9537-e91c093670ec None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.786063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cf332-3d65-4627-9537-e91c093670ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.797128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.797847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.798128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.798430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.799095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.801096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.809432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-928cf332-3d65-4627-9537-e91c093670ec None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:33.811318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-928cf332-3d65-4627-9537-e91c093670ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.825045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 950/1868] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:33.837210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.837569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.837853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.859670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 919/1869] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:33.861051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.862687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.874668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:33.876286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:33.926695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e652b-ef26-43e9-ac2c-8e58d04a8cef admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.931203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.931880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.932157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.932425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.933149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.934694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 951/1870] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:33.935066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.938856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.949216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0957-c105-431f-9ca2-b9c8a8dc69e0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.954465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.955296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.955519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.955841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.956619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:33.956931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.958607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.958904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 920/1871] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:33.963129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.973457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc60c02-4250-4497-b1b8-916c8d2423d4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.974235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 952/1872] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:40:33.978714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:33.981072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.981844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.982236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.982602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.983432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.985157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:33.988841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ff24-0c7f-4006-b6d7-798a7d3ef584 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:33.993575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:33.994233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:33.994515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:33.994796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:33.995475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:33.999622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 921/1873] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:33.999769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.000712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.013636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237931a8-60c8-4409-a011-f2fbc5dbaec5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.018691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.019807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.020279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.020810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] PATH_INFO: `/v3/projects/21cc4c4bd84c40a5a1cd0bf793c02877/users/8a08fe993ba546f896103492d22e2822/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.026733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 953/1874] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:34.030998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.037440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cc4c4bd84c40a5a1cd0bf793c02877, user_id=8a08fe993ba546f896103492d22e2822, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.040849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.060598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:34.062694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 922/1875] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:33 2022] PUT /identity/v3/projects/21cc4c4bd84c40a5a1cd0bf793c02877/users/8a08fe993ba546f896103492d22e2822/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:34.066945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.110520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e09a6-ccf5-4ecc-b540-c396aa8071ec admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.145004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e751c-c85c-49f4-ab10-e34e65b2d843 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.149820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.150495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.150795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.151189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.152683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.153609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.168251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 923/1876] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:34.169060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.178232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.178609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db31e8-97e2-4d8f-9605-89f2b7e21b67 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.179158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.179503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.179840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.180806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.183185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.184147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179016-9426-4229-aae2-ab9e059d3bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.185068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179016-9426-4229-aae2-ab9e059d3bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.185491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179016-9426-4229-aae2-ab9e059d3bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.185770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179016-9426-4229-aae2-ab9e059d3bce admin admin] PATH_INFO: `/v3/projects/21cc4c4bd84c40a5a1cd0bf793c02877/users/8a08fe993ba546f896103492d22e2822/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.187730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179016-9426-4229-aae2-ab9e059d3bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cc4c4bd84c40a5a1cd0bf793c02877, user_id=8a08fe993ba546f896103492d22e2822, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.190436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179016-9426-4229-aae2-ab9e059d3bce admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.201339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 924/1877] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:34 2022] PUT /identity/v3/projects/21cc4c4bd84c40a5a1cd0bf793c02877/users/8a08fe993ba546f896103492d22e2822/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:34.212892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.212892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.212892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.214809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 954/1878] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:34 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:34.216385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.218717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:34.228198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eed1cc-af06-4d25-b5ac-b2482623ea1f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.242776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] MFA Rules not processed for user `8a08fe993ba546f896103492d22e2822`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:34.244209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:34.288559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.289693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.289979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.290248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.290975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.292612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.302404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 955/1879] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:34.306362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.314138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 925/1880] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:34.316018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9a4da-9372-40fb-8163-2ff6ea76c9e4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.320934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.321589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.321870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.322243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.323019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.324869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.325205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.326800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:34.338241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 956/1881] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:34.339331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.348987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2399a-e4b0-4a47-ac78-4501b2b11b92 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.353553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd370cd-d3d6-461c-905d-05adee1cacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.354427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd370cd-d3d6-461c-905d-05adee1cacd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.354705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd370cd-d3d6-461c-905d-05adee1cacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.354981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd370cd-d3d6-461c-905d-05adee1cacd5 admin admin] PATH_INFO: `/v3/projects/d4a78b2d098a4ea5b3083fb5c2d41fad/users/9220632f43cb4b59b6a2fda771981894/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.371188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd370cd-d3d6-461c-905d-05adee1cacd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a78b2d098a4ea5b3083fb5c2d41fad, user_id=9220632f43cb4b59b6a2fda771981894, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.373877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd370cd-d3d6-461c-905d-05adee1cacd5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.385245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e0d85-c5bb-44b1-96ac-4c6f30bc4cec None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.388921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 957/1882] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:34 2022] PUT /identity/v3/projects/d4a78b2d098a4ea5b3083fb5c2d41fad/users/9220632f43cb4b59b6a2fda771981894/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:34.399492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.399778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.400052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.427365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] MFA Rules not processed for user `9220632f43cb4b59b6a2fda771981894`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:34.429513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:34.437772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.438463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.438582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:34.438742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.439018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.495903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:34.496285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 958/1883] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:34.500163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.500609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.501829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.513087 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 926/1884] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:34.598455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979800a4-ca18-4214-bcb5-6129321f62e6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.607851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.609065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.609446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.609838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.610703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.612873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.651390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 959/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:34 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:34.656281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.669990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25223b-4a9f-45a1-aba8-afc8360b507e service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.744509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.746051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.746732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.748844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.751420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.753749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.778228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 927/1886] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:34 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:34.782454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.794519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08e1e8-96cc-4b46-a078-53a97fd3547e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.797248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.799636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.800316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.800631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.800898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.801634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.803976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.815514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 960/1887] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:34.819784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.835592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854904-447e-48cf-abee-927015d8bc6c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.846631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.847682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.847973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.848253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] PATH_INFO: `/v3/projects/4f512aefa2de489d9d12ebb1e4047073/users/f0781ff96ac148be9eb4972034170481/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.859085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163c00-1a4f-4a1d-bd81-26f3e90a58f1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.863011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.863746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.864098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.864456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.864957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f512aefa2de489d9d12ebb1e4047073, user_id=f0781ff96ac148be9eb4972034170481, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.866442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:34.867687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.883726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 961/1888] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:34 2022] PUT /identity/v3/projects/4f512aefa2de489d9d12ebb1e4047073/users/f0781ff96ac148be9eb4972034170481/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:34.887727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:34.952264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.953841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.965918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ed31-c8bc-401a-8fa7-4845a509f998 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:34.967156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 928/1889] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:34.975645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afac8c3-1cc6-461e-8421-52c05f834842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:34.978350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac8c3-1cc6-461e-8421-52c05f834842 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:34.978856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac8c3-1cc6-461e-8421-52c05f834842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:34.979779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afac8c3-1cc6-461e-8421-52c05f834842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:34.981365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac8c3-1cc6-461e-8421-52c05f834842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:34.983315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afac8c3-1cc6-461e-8421-52c05f834842 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:34.988057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:35.000823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 962/1890] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:35.003662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:35.016832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd602d69-7a37-4529-9648-8c8126ef293f service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:35.022802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:35.023437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.023718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.023991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] PATH_INFO: `/v3/projects/4f512aefa2de489d9d12ebb1e4047073/users/f0781ff96ac148be9eb4972034170481/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.026278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f512aefa2de489d9d12ebb1e4047073, user_id=f0781ff96ac148be9eb4972034170481, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:35.029360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:35.044206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 929/1891] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:35 2022] PUT /identity/v3/projects/4f512aefa2de489d9d12ebb1e4047073/users/f0781ff96ac148be9eb4972034170481/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:35.055811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.056206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.056384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.086373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] MFA Rules not processed for user `f0781ff96ac148be9eb4972034170481`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:35.087557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.129250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:35.131198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.171801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:35.199763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 963/1892] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:35.199763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:35.199763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.244228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f0c73-27ae-452e-b1c4-c48c27003ec5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:35.253113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aee25-8457-406d-a324-10672da94666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:35.254226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aee25-8457-406d-a324-10672da94666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.254666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aee25-8457-406d-a324-10672da94666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.255098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aee25-8457-406d-a324-10672da94666 admin admin] PATH_INFO: `/v3/users/29dfffb3b37f4fd6b79182e0c6209e95` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.258017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aee25-8457-406d-a324-10672da94666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29dfffb3b37f4fd6b79182e0c6209e95)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:35.259962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aee25-8457-406d-a324-10672da94666 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:35.260830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3399ca-7d4c-4bc4-beb1-456eca9c7223 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:35.265352 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:35.266656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.267000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.267362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.271194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.347005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29dfffb3b37f4fd6b79182e0c6209e95'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:35.356769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29dfffb3b37f4fd6b79182e0c6209e95'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:35.357565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29dfffb3b37f4fd6b79182e0c6209e95'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:35.362577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:35.364310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927178-1d00-4d58-934f-aaa12cdea6d2 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:35.365638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29dfffb3b37f4fd6b79182e0c6209e95'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:35.366385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29dfffb3b37f4fd6b79182e0c6209e95'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:35.375254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 964/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:35.390571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 930/1894] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:35 2022] DELETE /identity/v3/users/29dfffb3b37f4fd6b79182e0c6209e95 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:35.392266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.392594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.392870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.426132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:35.428451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.428709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:35.430155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.484212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:35.504282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aee25-8457-406d-a324-10672da94666 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:35.515750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:35.517274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.517722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.518109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.520263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.521321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 965/1895] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:35.531917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:35.533416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:35.617082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:35.622706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:35.624858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:35.634702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfcfbd-abd4-4963-8009-d2e4c7ef0cb4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:35.638571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:35.639239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:35.639524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:35.639802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:35.640200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 931/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:35.650091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:35.651657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:35.669376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 966/1897] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:36.033169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.040097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:36.059244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7756061-2863-4f41-8003-2ac53ede1bed service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:36.064749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:36.065622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:36.065895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:36.066165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] PATH_INFO: `/v3/projects/346648e467034f68a5c91276905ae317` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:36.067380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346648e467034f68a5c91276905ae317)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:36.069863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:36.151026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346648e467034f68a5c91276905ae317', 'request_id': 'req-89a888da-9b71-414b-a3e9-e85a57e6c2d7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.151821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.153274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:36.174485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346648e467034f68a5c91276905ae317', 'request_id': 'req-89a888da-9b71-414b-a3e9-e85a57e6c2d7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.189061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346648e467034f68a5c91276905ae317', 'request_id': 'req-89a888da-9b71-414b-a3e9-e85a57e6c2d7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.202902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] The token cache is being invalidate because project 346648e467034f68a5c91276905ae317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:36.203451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.204136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.205850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 932/1898] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:36 2022] DELETE /identity/v3/projects/346648e467034f68a5c91276905ae317 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:36.210737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.212266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:36.294803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498bc6d-9d22-4647-8388-1222f7819040 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:36.355049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a888da-9b71-414b-a3e9-e85a57e6c2d7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:36.369205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:36.370566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:36.371003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:36.371434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] PATH_INFO: `/v3/users/b480ea14b4814ea9b39d96c1f2e4a91c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:36.374238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b480ea14b4814ea9b39d96c1f2e4a91c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:36.376449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:36.386381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323a6bd14e5f450fa803f02c484e95f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5606e8708d455eb43594d637185a81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:36.387678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:36.388186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:36.389513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:36.391589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:36.392528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:36.395980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:36.414581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 967/1899] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:40:36.416077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.419081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:36.449006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59250563-111c-4e74-a8d6-32bbf84fe9a4 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:36.455969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323a6bd14e5f450fa803f02c484e95f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5606e8708d455eb43594d637185a81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:36.456875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:36.457515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:36.457801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:36.462086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:36.470571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:36.480905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b480ea14b4814ea9b39d96c1f2e4a91c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.495062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b480ea14b4814ea9b39d96c1f2e4a91c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.495786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b480ea14b4814ea9b39d96c1f2e4a91c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.506618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:36.510883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b480ea14b4814ea9b39d96c1f2e4a91c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.511954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b480ea14b4814ea9b39d96c1f2e4a91c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:36.527409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:36.528876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 968/1900] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:36 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:36.533570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.540164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:36.548953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 933/1901] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:36 2022] DELETE /identity/v3/users/b480ea14b4814ea9b39d96c1f2e4a91c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:36.638172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d7a77-f51e-4195-b303-6c82017ab943 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:36.745896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323a6bd14e5f450fa803f02c484e95f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5606e8708d455eb43594d637185a81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:36.753962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:36.754523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:36.754994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:36.756007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:36.756739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:36.759200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:36.783100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 969/1902] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:36.920001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.932025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:36.936388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:36.946755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136da45-663f-433f-b319-c363f4c14783 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:36.956117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323a6bd14e5f450fa803f02c484e95f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a5606e8708d455eb43594d637185a81', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:36.957198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:36.957620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:36.958219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] PATH_INFO: `/v3/projects/c42bc43fde5a4ca08c665e7436fda739` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:36.959956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c42bc43fde5a4ca08c665e7436fda739)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:36.963730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.040866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42bc43fde5a4ca08c665e7436fda739', 'request_id': 'req-7acebc88-9e77-48de-857c-d4c801fc7420'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.043752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b954f2-fccc-4324-bf0e-f7778e308898 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:37.063507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42bc43fde5a4ca08c665e7436fda739', 'request_id': 'req-7acebc88-9e77-48de-857c-d4c801fc7420'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.077142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42bc43fde5a4ca08c665e7436fda739', 'request_id': 'req-7acebc88-9e77-48de-857c-d4c801fc7420'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.109389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:37.126448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] The token cache is being invalidate because project c42bc43fde5a4ca08c665e7436fda739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:37.127088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.127604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.129468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 934/1903] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:36 2022] DELETE /identity/v3/projects/c42bc43fde5a4ca08c665e7436fda739 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:37.134286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:37.135359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:37.135485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.135849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.136208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] PATH_INFO: `/v3/users/9220632f43cb4b59b6a2fda771981894` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.137391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.137824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9220632f43cb4b59b6a2fda771981894)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:37.139909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.158418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc88-9e77-48de-857c-d4c801fc7420 tempest-VolumeQuotaClassesTest-767499374 tempest-VolumeQuotaClassesTest-767499374-project-admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:37.163378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:37.164774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.165247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.165524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] PATH_INFO: `/v3/projects/33a7351d0d0e452dbf839e2ad270006d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.166871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a7351d0d0e452dbf839e2ad270006d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:37.169201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.222778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9220632f43cb4b59b6a2fda771981894'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.242748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9220632f43cb4b59b6a2fda771981894'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.243748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9220632f43cb4b59b6a2fda771981894'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.255869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9220632f43cb4b59b6a2fda771981894'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.256098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a7351d0d0e452dbf839e2ad270006d', 'request_id': 'req-1bc232a8-fc3c-4d4e-a953-61523a26eef7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.264962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee758184-85a2-4b58-92be-c2bfe3050d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9220632f43cb4b59b6a2fda771981894'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.266598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a7351d0d0e452dbf839e2ad270006d', 'request_id': 'req-1bc232a8-fc3c-4d4e-a953-61523a26eef7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.275271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a7351d0d0e452dbf839e2ad270006d', 'request_id': 'req-1bc232a8-fc3c-4d4e-a953-61523a26eef7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.278626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 970/1904] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:36 2022] DELETE /identity/v3/users/9220632f43cb4b59b6a2fda771981894 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:37.283514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.283746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.284112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.292602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] The token cache is being invalidate because project 33a7351d0d0e452dbf839e2ad270006d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:37.292900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.293741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.295347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 935/1905] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:37 2022] DELETE /identity/v3/projects/33a7351d0d0e452dbf839e2ad270006d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:37.300109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:37.302198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.310915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:37.311935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.417492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc232a8-fc3c-4d4e-a953-61523a26eef7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:37.428440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 971/1906] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:37.429835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:37.431570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:37.431918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.432931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.433675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.434048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] PATH_INFO: `/v3/users/71c0bdda097a4e2c98fc8e7f6702c73c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.435655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c0bdda097a4e2c98fc8e7f6702c73c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:37.439192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.444344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:37.507234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c0bdda097a4e2c98fc8e7f6702c73c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.507866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1636c0-1dfd-43e0-96aa-0fe250f232c9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:37.512796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:37.513723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.514099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.514917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.522511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c0bdda097a4e2c98fc8e7f6702c73c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.523805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c0bdda097a4e2c98fc8e7f6702c73c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.532499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:37.538801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.545797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c0bdda097a4e2c98fc8e7f6702c73c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.546051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f2c647-5424-4835-b85c-ba28e58071c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c0bdda097a4e2c98fc8e7f6702c73c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.556949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 972/1907] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:37.559431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:37.560097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.583598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54c026-6f0e-467c-a48d-3285e29c9c9a service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:37.589174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 936/1908] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:37 2022] DELETE /identity/v3/users/71c0bdda097a4e2c98fc8e7f6702c73c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:37.590460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:37.591358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.591755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.592443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] PATH_INFO: `/v3/users/f0a348743b6146d39d4266e3670ad731` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.593502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a348743b6146d39d4266e3670ad731)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:37.595566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.598078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:37.687786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a348743b6146d39d4266e3670ad731'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.714134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a348743b6146d39d4266e3670ad731'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.715054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a348743b6146d39d4266e3670ad731'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.732115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a348743b6146d39d4266e3670ad731'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.749946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a348743b6146d39d4266e3670ad731'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:37.766618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 973/1909] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:37 2022] DELETE /identity/v3/users/f0a348743b6146d39d4266e3670ad731 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:37.771491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.771976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.772422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.798095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:37.799505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.874614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 937/1910] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:37.885131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:37.887390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:37.960645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0740f29-333d-4eaf-86da-6365187303f8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:37.965424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:37.966371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:37.966480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:37.967552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:37.977376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:37.978895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:37.990646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 974/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:38.126375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.128361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.137438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.138867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.147813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5cadf-44ed-4855-acae-67c9a72c7ae1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.156321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d657bd0-560d-4937-af37-30aba9e820e6 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.164944 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.165863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.167065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.167457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] PATH_INFO: `/v3/projects/d4a78b2d098a4ea5b3083fb5c2d41fad` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.169328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a78b2d098a4ea5b3083fb5c2d41fad)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.171793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.171933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.172738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.173114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.174436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] PATH_INFO: `/v3/projects/fdbccfd0cb7541cc8dd0f37b68b42397` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.176168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbccfd0cb7541cc8dd0f37b68b42397)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.182003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.269171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbccfd0cb7541cc8dd0f37b68b42397', 'request_id': 'req-5ed78f4c-40fd-4887-baf8-7f8a6253d978'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.270277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a78b2d098a4ea5b3083fb5c2d41fad', 'request_id': 'req-06c0270d-8455-42f9-acde-651510fe5e63'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.289509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a78b2d098a4ea5b3083fb5c2d41fad', 'request_id': 'req-06c0270d-8455-42f9-acde-651510fe5e63'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.297097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a78b2d098a4ea5b3083fb5c2d41fad', 'request_id': 'req-06c0270d-8455-42f9-acde-651510fe5e63'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.300451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbccfd0cb7541cc8dd0f37b68b42397', 'request_id': 'req-5ed78f4c-40fd-4887-baf8-7f8a6253d978'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.322697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbccfd0cb7541cc8dd0f37b68b42397', 'request_id': 'req-5ed78f4c-40fd-4887-baf8-7f8a6253d978'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.322908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] The token cache is being invalidate because project d4a78b2d098a4ea5b3083fb5c2d41fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:38.323183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.324661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.329752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 938/1912] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:38 2022] DELETE /identity/v3/projects/d4a78b2d098a4ea5b3083fb5c2d41fad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:38.333950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.337466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.339805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] The token cache is being invalidate because project fdbccfd0cb7541cc8dd0f37b68b42397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:38.340041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.340760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5ed78f4c-40fd-4887-baf8-7f8a6253d978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.342968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 975/1913] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:38 2022] DELETE /identity/v3/projects/fdbccfd0cb7541cc8dd0f37b68b42397 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:38.349578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.349872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.350155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.351034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:38.360561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:38.383480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:38.385637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.475870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0270d-8455-42f9-acde-651510fe5e63 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.552900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 976/1914] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:38.554256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.555635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.576059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeacdfb-cbb0-4892-8aef-1d64715af7c7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.581740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.582923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.583291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.583857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] PATH_INFO: `/v3/users/f0781ff96ac148be9eb4972034170481` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.585327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0781ff96ac148be9eb4972034170481)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.587456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.588417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.589492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.589774 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.590102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] PATH_INFO: `/v3/projects/978b747d34d341e3bfc64923669991a7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.593434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978b747d34d341e3bfc64923669991a7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.597655 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.659614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0781ff96ac148be9eb4972034170481'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.672157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0781ff96ac148be9eb4972034170481'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.673462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0781ff96ac148be9eb4972034170481'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.687208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0781ff96ac148be9eb4972034170481'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.687877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3efd3c88-2486-4e92-9ec1-29c69edddd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0781ff96ac148be9eb4972034170481'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.705057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978b747d34d341e3bfc64923669991a7', 'request_id': 'req-7a02dbae-f33b-4801-8c29-f4985973c064'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.714513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978b747d34d341e3bfc64923669991a7', 'request_id': 'req-7a02dbae-f33b-4801-8c29-f4985973c064'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.729433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978b747d34d341e3bfc64923669991a7', 'request_id': 'req-7a02dbae-f33b-4801-8c29-f4985973c064'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.729761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 939/1915] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:38 2022] DELETE /identity/v3/users/f0781ff96ac148be9eb4972034170481 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:38.731368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.731722 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.732165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.744966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] The token cache is being invalidate because project 978b747d34d341e3bfc64923669991a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:38.745311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.746550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:38.751974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 977/1916] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:38 2022] DELETE /identity/v3/projects/978b747d34d341e3bfc64923669991a7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:38.753036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.754416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.763812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:38.766256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:38.810428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:38.840003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02dbae-f33b-4801-8c29-f4985973c064 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.877030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 940/1917] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:38.878636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.896006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8688d8-cd32-45d5-9a4a-30f8d6ef7ab6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.896437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:38.901995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.902827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.903115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.903474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.904233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:38.905009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.906631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.920953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 941/1918] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:38.925334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:38.932340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.933543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.934002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.934454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] PATH_INFO: `/v3/users/323a6bd14e5f450fa803f02c484e95f6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.936281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473adb-32e3-4a58-a072-ea86fcdcd51e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:38.937035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323a6bd14e5f450fa803f02c484e95f6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.939099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.941848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:38.942580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:38.942974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:38.943250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:38.944063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:38.946262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:38.978379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 942/1919] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:38 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:38.982473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.030374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323a6bd14e5f450fa803f02c484e95f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.051863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323a6bd14e5f450fa803f02c484e95f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.053070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323a6bd14e5f450fa803f02c484e95f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.058253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979ae5-63bd-48ac-9858-75e6b4de3cad admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.062586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323a6bd14e5f450fa803f02c484e95f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.073325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323a6bd14e5f450fa803f02c484e95f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.079806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.080814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.081190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.081547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.082387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.084511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.088596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 978/1920] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:38 2022] DELETE /identity/v3/users/323a6bd14e5f450fa803f02c484e95f6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:39.114884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 943/1921] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:38 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:39.118707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.121032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.153442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.157639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.182933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6a835-238d-4569-8c15-b565d94d6fa0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.242592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51fff4-5c31-4efd-a362-2fad99e52f60 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.251579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.252406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.252829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.253194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.254137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.256057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.271139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 979/1922] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:39.272253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.278994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.281196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.281611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.281917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] PATH_INFO: `/v3/projects/4f512aefa2de489d9d12ebb1e4047073` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.283363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f512aefa2de489d9d12ebb1e4047073)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.284126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f714b9-d17a-431e-a2ab-9ae36b6eb603 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.285603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.292920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.293763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.294095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.294997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.295291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.297087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.311391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 980/1923] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:39.312846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.324775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e549880-dd68-440e-86bf-a6099889b2dc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.330482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:39.332133 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f98c0-cdbb-492a-aa56-0c2d38458927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.332304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f98c0-cdbb-492a-aa56-0c2d38458927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.332614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f98c0-cdbb-492a-aa56-0c2d38458927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.333273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f98c0-cdbb-492a-aa56-0c2d38458927 admin admin] PATH_INFO: `/v3/projects/6653016b92fe4edb892bba240ce6eec4/users/89bba41a55724717b5a71a0a1f5b3139/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.355754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f512aefa2de489d9d12ebb1e4047073', 'request_id': 'req-e3175f59-40c2-42f1-89e5-efce05ec4b8a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.368804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f512aefa2de489d9d12ebb1e4047073', 'request_id': 'req-e3175f59-40c2-42f1-89e5-efce05ec4b8a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.374062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f98c0-cdbb-492a-aa56-0c2d38458927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6653016b92fe4edb892bba240ce6eec4, user_id=89bba41a55724717b5a71a0a1f5b3139, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.378841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f512aefa2de489d9d12ebb1e4047073', 'request_id': 'req-e3175f59-40c2-42f1-89e5-efce05ec4b8a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.379146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f98c0-cdbb-492a-aa56-0c2d38458927 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.393733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] The token cache is being invalidate because project 4f512aefa2de489d9d12ebb1e4047073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:39.394026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.394969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e3175f59-40c2-42f1-89e5-efce05ec4b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.400323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 944/1924] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:39 2022] DELETE /identity/v3/projects/4f512aefa2de489d9d12ebb1e4047073 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:39.407821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 981/1925] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:39 2022] PUT /identity/v3/projects/6653016b92fe4edb892bba240ce6eec4/users/89bba41a55724717b5a71a0a1f5b3139/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:39.413081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83a54-b97c-409d-9a52-11f9fcfedfd0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.413788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83a54-b97c-409d-9a52-11f9fcfedfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.414182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c83a54-b97c-409d-9a52-11f9fcfedfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.422379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.422980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.423289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.437530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-15c83a54-b97c-409d-9a52-11f9fcfedfd0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:39.438766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15c83a54-b97c-409d-9a52-11f9fcfedfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.455509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] MFA Rules not processed for user `89bba41a55724717b5a71a0a1f5b3139`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:39.456846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.461758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:39.510332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 945/1926] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:39.517967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.518258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.518533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.541863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:39.543160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.547867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 982/1927] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:39.557945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 946/1928] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:39.561482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.562107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.563877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.571852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cbc97-5588-41b3-811d-fd960cc7cae9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.576727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.577438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.577760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.578064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.578767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:39.579079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.597360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.613085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 983/1929] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:39.614044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.616181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.629897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2a033-1e60-4081-920c-73c1c45f1467 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.635288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.635575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.635870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.636131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] PATH_INFO: `/v3/projects/8a5606e8708d455eb43594d637185a81` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.637398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5606e8708d455eb43594d637185a81)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.639338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.640951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefff02b-52c5-4f85-9d8a-caa5193f2010 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.645229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.645995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.646277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.646549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.658924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.660378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.671144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 947/1930] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:39.671779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.684581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b42654-d2d7-426a-855d-3f5ccbc60971 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.690963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.691640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.691918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.692182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.692989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.697444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.712220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5606e8708d455eb43594d637185a81', 'request_id': 'req-e8d059be-cfc0-4387-ac4c-b8e27827c444'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.718444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5606e8708d455eb43594d637185a81', 'request_id': 'req-e8d059be-cfc0-4387-ac4c-b8e27827c444'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.727788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5606e8708d455eb43594d637185a81', 'request_id': 'req-e8d059be-cfc0-4387-ac4c-b8e27827c444'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.740601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 948/1931] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:39.741381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] The token cache is being invalidate because project 8a5606e8708d455eb43594d637185a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:39.741766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.741882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.742580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.743875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.745075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 984/1932] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:39 2022] DELETE /identity/v3/projects/8a5606e8708d455eb43594d637185a81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:39.746215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.748259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.790938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:39.826122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d059be-cfc0-4387-ac4c-b8e27827c444 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.826948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec4f3-54f1-45f8-ac90-ac9794b43781 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.831174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7aeb-c732-489f-b113-7e6c11549d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.831496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.831866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7aeb-c732-489f-b113-7e6c11549d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.832154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7aeb-c732-489f-b113-7e6c11549d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.832453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.832558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7aeb-c732-489f-b113-7e6c11549d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.832762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.833025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] PATH_INFO: `/v3/users/89bba41a55724717b5a71a0a1f5b3139` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.833605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7aeb-c732-489f-b113-7e6c11549d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.834418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bba41a55724717b5a71a0a1f5b3139)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.836003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7aeb-c732-489f-b113-7e6c11549d1b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.838109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.867951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 985/1933] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:39.877209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.880653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.881209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.892524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:39.905124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bba41a55724717b5a71a0a1f5b3139'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.914223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:39.914450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bba41a55724717b5a71a0a1f5b3139'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.915064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bba41a55724717b5a71a0a1f5b3139'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.915785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.923335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bba41a55724717b5a71a0a1f5b3139'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.924099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bba41a55724717b5a71a0a1f5b3139'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:39.924818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 986/1934] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:39.925454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.935253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcdacc-10fa-488d-ba85-b241229c4371 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:39.940337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73b63-3065-4198-9911-1e08ea0776b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:39.941127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73b63-3065-4198-9911-1e08ea0776b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.941407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73b63-3065-4198-9911-1e08ea0776b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.941718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73b63-3065-4198-9911-1e08ea0776b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.942517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73b63-3065-4198-9911-1e08ea0776b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:39.944507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73b63-3065-4198-9911-1e08ea0776b5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:39.960769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 987/1935] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:39.962969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:39.963328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:39.963716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:39.970673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 949/1936] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:39 2022] DELETE /identity/v3/users/89bba41a55724717b5a71a0a1f5b3139 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:39.973847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:39.975542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:39.994112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:39.996448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:40.058280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c26444-57e9-4a85-8e1a-e6171bcb2874 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.067223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a1cb5-8e8e-4e6d-97f1-2e1983e9d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.068334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a1cb5-8e8e-4e6d-97f1-2e1983e9d4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.068867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a1cb5-8e8e-4e6d-97f1-2e1983e9d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.069282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a1cb5-8e8e-4e6d-97f1-2e1983e9d4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.070417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a1cb5-8e8e-4e6d-97f1-2e1983e9d4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.073401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a1cb5-8e8e-4e6d-97f1-2e1983e9d4c7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.087235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 950/1937] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:40.088718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.089012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.089311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.090393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 988/1938] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:40.093768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.107182 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51810a7d-f9b9-4073-be35-8171abeb619c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.111387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:40.112576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:40.114046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.115213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.115575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.115992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] PATH_INFO: `/v3/projects/5323341df28843268d971ef3fb8e839e/users/32a2ff1a7129440b92909a3d17c0661d/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.123245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 951/1939] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:40.124272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.137739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5323341df28843268d971ef3fb8e839e, user_id=32a2ff1a7129440b92909a3d17c0661d, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.138637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f6a32-e819-4914-9284-465d49f7a24d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.140696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.144495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.145255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.145711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.145835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.146768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:40.146951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.148732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.162359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 989/1941] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:40 2022] PUT /identity/v3/projects/5323341df28843268d971ef3fb8e839e/users/32a2ff1a7129440b92909a3d17c0661d/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:40.162524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 952/1941] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:40.163936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.166256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:40.167300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.178840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467132b7-5023-4551-afb6-42f2129f7115 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.213778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:40.242781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc84af-cf14-4c4c-b05a-f62f66a65a35 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.250936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.251609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.251930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.252206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.262098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de914c4f-926e-40db-b3a4-2ad05875adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.262927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914c4f-926e-40db-b3a4-2ad05875adbf admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.263276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914c4f-926e-40db-b3a4-2ad05875adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.263614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914c4f-926e-40db-b3a4-2ad05875adbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.264385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de914c4f-926e-40db-b3a4-2ad05875adbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.266716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de914c4f-926e-40db-b3a4-2ad05875adbf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.304256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 953/1942] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:40.305575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2834-82e8-4b0d-acfe-9e2e1ada7b65 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.305931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2834-82e8-4b0d-acfe-9e2e1ada7b65 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.306276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2834-82e8-4b0d-acfe-9e2e1ada7b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.336654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.338116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.344652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d6ed2834-82e8-4b0d-acfe-9e2e1ada7b65 None None] MFA Rules not processed for user `32a2ff1a7129440b92909a3d17c0661d`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:40.346043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d6ed2834-82e8-4b0d-acfe-9e2e1ada7b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:40.350238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 990/1943] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:40.351194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.362455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f71e17-d685-46ac-a87f-b3eeb15b43c8 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.376541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:40.486513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.488151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.488650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.490004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.490965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.494698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.517347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 954/1944] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:40.519116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e645-8467-4c55-a0ec-03f6a607f8ca None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.519908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e645-8467-4c55-a0ec-03f6a607f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.520593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5e645-8467-4c55-a0ec-03f6a607f8ca None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.530095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 955/1945] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:40:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:40:40.536996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 991/1946] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:40.537169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e645-8467-4c55-a0ec-03f6a607f8ca None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.538718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.578099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd43cad-c7e9-491e-9077-3e989031d6d8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.581230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5e645-8467-4c55-a0ec-03f6a607f8ca None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.587057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.587743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.588031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.588338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.589040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.590228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f8c1-eb1a-4767-a8a2-f5a4e8396fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.591106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f8c1-eb1a-4767-a8a2-f5a4e8396fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.591287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.591394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f8c1-eb1a-4767-a8a2-f5a4e8396fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.591657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f8c1-eb1a-4767-a8a2-f5a4e8396fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.592937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f8c1-eb1a-4767-a8a2-f5a4e8396fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.595993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f8c1-eb1a-4767-a8a2-f5a4e8396fa1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.614588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 992/1947] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:40.615981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.617248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.617431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.632534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 956/1948] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:40.634355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.643648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:40.645416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:40.718751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549a41-6471-4461-ad3e-b5e99b5a3713 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.731596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.733564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.733742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.733997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.734741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.736717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.752276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 957/1949] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:40.753258 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.765109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839beacf-cfe9-4763-8feb-63e4129ab6f0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.766603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 993/1950] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:40.768784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.776984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.777684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.777964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.778236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.778939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.782344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df1889-deb0-4b6f-baea-5ac1e28fa2e6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.783322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.789394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.791136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.791716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.792142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] PATH_INFO: `/v3/projects/790839bfda254d6f810c0ffb2739123d/users/3adcf21cc9f147ad827bc29254f7f44d/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.815977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790839bfda254d6f810c0ffb2739123d, user_id=3adcf21cc9f147ad827bc29254f7f44d, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:40.819795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:40.822739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:40.831320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 958/1951] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:40 2022] POST /identity/v3/users => generated 296 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:40.832187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.835432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:40.859580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 994/1952] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:40 2022] PUT /identity/v3/projects/790839bfda254d6f810c0ffb2739123d/users/3adcf21cc9f147ad827bc29254f7f44d/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:40.861134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:40.876432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02453a1f-a490-4a98-8fe9-a857ca36345b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.989153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cde757-2ab3-4d7d-90b5-bae450230500 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:40.995700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c8b53-2ff6-4ab6-8857-7ae95a4e3834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:40.996840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8b53-2ff6-4ab6-8857-7ae95a4e3834 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:40.997129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8b53-2ff6-4ab6-8857-7ae95a4e3834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:40.997402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8b53-2ff6-4ab6-8857-7ae95a4e3834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:40.998148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c8b53-2ff6-4ab6-8857-7ae95a4e3834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.000211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c8b53-2ff6-4ab6-8857-7ae95a4e3834 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.002924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:41.010328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.011310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.012241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.013503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.022818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 995/1953] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:41.024682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.024914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.025390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.031521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.034693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.053606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 959/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:41.053606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.056861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.078708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] MFA Rules not processed for user `3adcf21cc9f147ad827bc29254f7f44d`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:41.080777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d8fbd-e4d1-4fe8-a534-2f49ce246575 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.084868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.087390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.088898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.089188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.089468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] PATH_INFO: `/v3/projects/6653016b92fe4edb892bba240ce6eec4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.091432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6653016b92fe4edb892bba240ce6eec4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.093850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.189443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6653016b92fe4edb892bba240ce6eec4', 'request_id': 'req-c036916e-a84e-4a53-8bdb-d213ccf46b28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.201869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6653016b92fe4edb892bba240ce6eec4', 'request_id': 'req-c036916e-a84e-4a53-8bdb-d213ccf46b28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.211396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6653016b92fe4edb892bba240ce6eec4', 'request_id': 'req-c036916e-a84e-4a53-8bdb-d213ccf46b28'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.224763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] The token cache is being invalidate because project 6653016b92fe4edb892bba240ce6eec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:41.225057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.228834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.230839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 960/1955] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:41 2022] DELETE /identity/v3/projects/6653016b92fe4edb892bba240ce6eec4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:41.232889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.235391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.266472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 996/1956] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:41.267869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.271013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.295493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f991f-9a70-4514-9978-68de757514f4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.314968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036916e-a84e-4a53-8bdb-d213ccf46b28 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.319952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b55578-5e28-4cf1-bad4-19243e058820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.321129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55578-5e28-4cf1-bad4-19243e058820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.321407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55578-5e28-4cf1-bad4-19243e058820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.321678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55578-5e28-4cf1-bad4-19243e058820 admin admin] PATH_INFO: `/v3/projects/283d9e5361a3410ab69423ce53aa77fa/users/2e95841f489b4b17b243ca412649c2e1/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.333555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:41.339390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55578-5e28-4cf1-bad4-19243e058820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283d9e5361a3410ab69423ce53aa77fa, user_id=2e95841f489b4b17b243ca412649c2e1, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.342269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55578-5e28-4cf1-bad4-19243e058820 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.361927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 961/1957] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:41 2022] PUT /identity/v3/projects/283d9e5361a3410ab69423ce53aa77fa/users/2e95841f489b4b17b243ca412649c2e1/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:41.361927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.361927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.361927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.374036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.374948 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.375299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.375635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] PATH_INFO: `/v3/users/3ebd845b9aa84d18b5a252175e6ce799` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.376967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebd845b9aa84d18b5a252175e6ce799)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.378992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.379267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:41.380720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.435746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebd845b9aa84d18b5a252175e6ce799'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.448834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebd845b9aa84d18b5a252175e6ce799'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.449550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebd845b9aa84d18b5a252175e6ce799'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.452706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 962/1958] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:41.453616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.456638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.459986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebd845b9aa84d18b5a252175e6ce799'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.469298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a453cf-3ad0-4f54-956e-015465b3194d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.470150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebd845b9aa84d18b5a252175e6ce799'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:41.475326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64560f-63ae-47ef-9db6-d7bb2029d02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.476214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64560f-63ae-47ef-9db6-d7bb2029d02e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.476688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64560f-63ae-47ef-9db6-d7bb2029d02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.476908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64560f-63ae-47ef-9db6-d7bb2029d02e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.477401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 997/1959] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:41 2022] DELETE /identity/v3/users/3ebd845b9aa84d18b5a252175e6ce799 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:41.478116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.479709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.481177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64560f-63ae-47ef-9db6-d7bb2029d02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.483837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64560f-63ae-47ef-9db6-d7bb2029d02e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.486625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:41.519615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 963/1960] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/projects => generated 393 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:41.521355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5adb-6c1c-40e8-8a30-1a3a2ea47b66 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.521806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5adb-6c1c-40e8-8a30-1a3a2ea47b66 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.522317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5adb-6c1c-40e8-8a30-1a3a2ea47b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.544062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a2ea5adb-6c1c-40e8-8a30-1a3a2ea47b66 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:41.545411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a2ea5adb-6c1c-40e8-8a30-1a3a2ea47b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.561448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0a5dd-b436-4755-b2ae-caf7d83f4250 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.614681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 964/1961] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:41.616227 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.616545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.616821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.627390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.628425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.628804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.629140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.629942 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.631830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.634627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:41.636453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.645610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 998/1962] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:41.645610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.645917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 965/1963] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:41.645917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.649847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.656220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0135e-6351-4f18-8c46-c7b17765b2a1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.661059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.661838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.662122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.662397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.663168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:41.663836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.665521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.667794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea22fa-1118-4226-9344-5f6a85520714 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.672669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.673486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.673872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.674249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.675036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.677349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.679699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 966/1964] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:41.680859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.696677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6e07-64ad-4c8d-9504-841ac149d53e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.701923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.703191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.703191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.703490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] PATH_INFO: `/v3/projects/283d9e5361a3410ab69423ce53aa77fa/users/2e95841f489b4b17b243ca412649c2e1/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.707709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 999/1965] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/users => generated 303 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:41.707858 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283d9e5361a3410ab69423ce53aa77fa, user_id=2e95841f489b4b17b243ca412649c2e1, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.707987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.708810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.709370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.721407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 967/1966] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:41 2022] PUT /identity/v3/projects/283d9e5361a3410ab69423ce53aa77fa/users/2e95841f489b4b17b243ca412649c2e1/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:41.722005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.765486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:41.789977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b64de3-474e-4452-b12f-8af0da76cfce admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.799535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139207-981c-4ea6-bd99-dd881bbaec03 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.805878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.806831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.807119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.807397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.808104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.810178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.842656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 968/1967] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:41.843740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.856775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:41.866724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45b54a-173e-4d04-a40c-c0e4f748e6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.868668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b54a-173e-4d04-a40c-c0e4f748e6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.868941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b54a-173e-4d04-a40c-c0e4f748e6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.869218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45b54a-173e-4d04-a40c-c0e4f748e6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.894546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45b54a-173e-4d04-a40c-c0e4f748e6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.896166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45b54a-173e-4d04-a40c-c0e4f748e6c1 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.910399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1000/1968] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:41.912597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.912597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.912597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.925538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb5a7-38d2-44aa-b704-49d066c6d330 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.932731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.933532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.933876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.934249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.935233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.938554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:41.946884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] MFA Rules not processed for user `2e95841f489b4b17b243ca412649c2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:41.949285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:41.952889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 969/1969] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:41.954103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:41.968089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b265d5-0f9c-4e6d-9a9c-ddd3680033e8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:41.973618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:41.974454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:41.974768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:41.975084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:41.975795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:41.977874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.003769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 970/1970] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:42.003769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.024597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573ae2c-b4a3-4fb9-abd0-1f4a8a0a896c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.039568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.040582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.043037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.043469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] PATH_INFO: `/v3/projects/328c2fc424cb4825ad120e523f596515/users/08f4ec70bfdd4e738a0926230170be99/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.087524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328c2fc424cb4825ad120e523f596515, user_id=08f4ec70bfdd4e738a0926230170be99, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.095139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.101237 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1001/1971] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:42.102446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.145409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b5f2-81f7-4919-b091-2e1f0cded793 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.147482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 971/1972] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:42 2022] PUT /identity/v3/projects/328c2fc424cb4825ad120e523f596515/users/08f4ec70bfdd4e738a0926230170be99/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:42.148379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.151948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.249727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.250427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.250704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.250974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.251954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.254177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.257012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2503ad-2dc3-45ed-8f7e-b26e7866b595 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.263259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.264405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.265141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.265587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.272021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1002/1973] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:42.272021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.291436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79975bf8-63de-4035-8eee-4b6c6dd30583 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.296314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.297149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.299359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.299803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.300732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.302784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.315198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1003/1974] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:42.316425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.327520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:42.330231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9271a3-7d3e-49b0-a350-5d345487d846 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.340329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.341715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.342007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.342332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.343753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.348128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.360552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1004/1975] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:42.361340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.373892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bdd11-f709-4910-a59f-cbfababe8f6a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.377874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.378955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.379906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.380090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.380222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.380543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] PATH_INFO: `/v3/projects/328c2fc424cb4825ad120e523f596515/users/08f4ec70bfdd4e738a0926230170be99/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.382759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=328c2fc424cb4825ad120e523f596515, user_id=08f4ec70bfdd4e738a0926230170be99, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.385540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.393331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 972/1976] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:42.394680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.396230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.406885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1005/1977] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:42 2022] PUT /identity/v3/projects/328c2fc424cb4825ad120e523f596515/users/08f4ec70bfdd4e738a0926230170be99/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:42.407898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.415984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a6876-0f9d-4c4b-93d1-dcafbc0a44b4 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.464992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:42.503045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.504040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.504447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.504812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] PATH_INFO: `/v3/projects/d6c7a6807cc442e0a356753f52d4af70` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.506239 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c7a6807cc442e0a356753f52d4af70)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.506474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da79e2-5275-4600-a77c-8ed8605bb33f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.508850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.515168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bfd42-7541-4b44-b1bb-836601347075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.516095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfd42-7541-4b44-b1bb-836601347075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.516379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfd42-7541-4b44-b1bb-836601347075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.516689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfd42-7541-4b44-b1bb-836601347075 admin admin] PATH_INFO: `/v3/projects/9b047d68d215495aa00f2816e60ccfd5/users/f3bb0fcbd0934dc2b240734db6fbcb04/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.540161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bfd42-7541-4b44-b1bb-836601347075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b047d68d215495aa00f2816e60ccfd5, user_id=f3bb0fcbd0934dc2b240734db6fbcb04, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.543328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bfd42-7541-4b44-b1bb-836601347075 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.565991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1006/1978] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:42 2022] PUT /identity/v3/projects/9b047d68d215495aa00f2816e60ccfd5/users/f3bb0fcbd0934dc2b240734db6fbcb04/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:42.570559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.571152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.571490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.575071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c7a6807cc442e0a356753f52d4af70', 'request_id': 'req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.588172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c7a6807cc442e0a356753f52d4af70', 'request_id': 'req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.595902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c7a6807cc442e0a356753f52d4af70', 'request_id': 'req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.610738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] MFA Rules not processed for user `08f4ec70bfdd4e738a0926230170be99`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:42.612001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.614924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] The token cache is being invalidate because project d6c7a6807cc442e0a356753f52d4af70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:42.615367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.616526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-226b4d7f-3b08-40b4-9cd9-78b1626ad8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.618582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 973/1979] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:42 2022] DELETE /identity/v3/projects/d6c7a6807cc442e0a356753f52d4af70 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:42.619946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.620675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.621009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.651684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] MFA Rules not processed for user `f3bb0fcbd0934dc2b240734db6fbcb04`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:42.652931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.701190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1007/1980] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:42.702360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.703877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.714507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:42.750641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 974/1981] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:42.750641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.750641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.774098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4457d-49b0-4cf1-bc8c-db876da47d65 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.778828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.779717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.780003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.780282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] PATH_INFO: `/v3/users/8a08fe993ba546f896103492d22e2822` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.781511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a08fe993ba546f896103492d22e2822)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.783475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.812748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb5c31-d6b5-4352-8d44-b38f7729480c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.816777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.817589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.818014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.818358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.827539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.829022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.830602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:42.832296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a08fe993ba546f896103492d22e2822'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.839961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 975/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:42.840896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.842356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.847741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a08fe993ba546f896103492d22e2822'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.848551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a08fe993ba546f896103492d22e2822'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.854686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187b5e9-aae7-4a8c-92b5-6e83c6539bfd service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:42.859248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:42.859451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a08fe993ba546f896103492d22e2822'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.859924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:42.860267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:42.860573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:42.862726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:42.867980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a08fe993ba546f896103492d22e2822'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:42.874398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1008/1983] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:42 2022] DELETE /identity/v3/users/8a08fe993ba546f896103492d22e2822 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:42.875081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:42.876552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:42.891057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 976/1984] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:42.967718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:42.969637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.047573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d603b-2bd2-42e6-88db-2433281e76fd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.054737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.055195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.055749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.056125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.059271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.137698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.139487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:43.155690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1009/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:43.202740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:43.206935 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.222872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd099c-81c7-430b-acce-24229771286d service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.293929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.301277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.301277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.301277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] PATH_INFO: `/v3/users/32a2ff1a7129440b92909a3d17c0661d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.303994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a2ff1a7129440b92909a3d17c0661d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.307159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:43.313832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:43.315728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.339823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc08d21-1ec9-43fb-9477-d7db043a7e74 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.350711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.351847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.352340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.353013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] PATH_INFO: `/v3/projects/21cc4c4bd84c40a5a1cd0bf793c02877` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.354739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cc4c4bd84c40a5a1cd0bf793c02877)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.357125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:43.431389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a2ff1a7129440b92909a3d17c0661d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.453129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a2ff1a7129440b92909a3d17c0661d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.454272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a2ff1a7129440b92909a3d17c0661d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.463276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cc4c4bd84c40a5a1cd0bf793c02877', 'request_id': 'req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.474412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cc4c4bd84c40a5a1cd0bf793c02877', 'request_id': 'req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.480021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a2ff1a7129440b92909a3d17c0661d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.481791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7ba786de-a6f1-4b66-817d-c1d960220c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a2ff1a7129440b92909a3d17c0661d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.489024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cc4c4bd84c40a5a1cd0bf793c02877', 'request_id': 'req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.499676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:43.501346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:43.512853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 977/1986] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:43 2022] DELETE /identity/v3/users/32a2ff1a7129440b92909a3d17c0661d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:43.513432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] The token cache is being invalidate because project 21cc4c4bd84c40a5a1cd0bf793c02877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:43.513818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.514633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc4bfd96-2123-4d92-b7c0-688ff6c01c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:43.520265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1010/1987] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:43 2022] DELETE /identity/v3/projects/21cc4c4bd84c40a5a1cd0bf793c02877 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:43.521363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.521850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.522274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.523125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afce2b-7ad7-4f31-95d3-aa9ff44f4c1b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.523875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afce2b-7ad7-4f31-95d3-aa9ff44f4c1b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.524365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afce2b-7ad7-4f31-95d3-aa9ff44f4c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.550121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:43.555106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4afce2b-7ad7-4f31-95d3-aa9ff44f4c1b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:43.556019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4afce2b-7ad7-4f31-95d3-aa9ff44f4c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.563584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.656187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1011/1988] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:43.666702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.667067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.667489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.700309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:43.703277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.709624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 978/1989] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:43.717857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:43.724368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1012/1990] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:43.724545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:43.729592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:43.743779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec7367-3fb3-4df8-a61d-f2c5e4b65520 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.750714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.751593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.751937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.752449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.753373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:43.753786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.756726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:43.779282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1013/1991] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:43.780896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:43.793186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef8673-1527-402d-a3c3-1e11891fd2d6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.798260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.799345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.799690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.800037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.800840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.803239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:43.863005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1014/1992] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:43 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:43.867071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:43.904336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1527b-65f2-4ed8-82c6-7f05f98102b5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.963626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131ecd0-9384-4af8-907f-74dfe9394686 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:43.970591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.971342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.971463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:43.971760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.972100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.972364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:43.972758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:43.973239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:43.974786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.985136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:43.985930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:43.986891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.000965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 979/1993] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:44.027560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1015/1994] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:43 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:44.032341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.053730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95848b33-4213-4e05-8027-c9ab80a12074 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:44.061803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:44.063515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.063984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.064249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.066408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:44.081652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.092936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 980/1995] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:44.097337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.109020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f2456-1964-40a6-86b3-3f4940a73a8c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:44.114382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af957-fec1-4be9-810f-3685a7981740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:44.115054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af957-fec1-4be9-810f-3685a7981740 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.115364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af957-fec1-4be9-810f-3685a7981740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.115640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af957-fec1-4be9-810f-3685a7981740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.116698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af957-fec1-4be9-810f-3685a7981740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:44.118099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af957-fec1-4be9-810f-3685a7981740 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.129278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1016/1996] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:44.134103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.145230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97951-2887-413c-8800-19e82ca539c9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:44.150350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:44.151228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.151515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.151811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] PATH_INFO: `/v3/projects/da58fa0a837d45c7bba43ec3dd932dfa/users/fc5f8ead884c4c2980dcf417767b6e97/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.174191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da58fa0a837d45c7bba43ec3dd932dfa, user_id=fc5f8ead884c4c2980dcf417767b6e97, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:44.176913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.190811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 981/1997] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:44 2022] PUT /identity/v3/projects/da58fa0a837d45c7bba43ec3dd932dfa/users/fc5f8ead884c4c2980dcf417767b6e97/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:44.201551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.201832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.202107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.228910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] MFA Rules not processed for user `fc5f8ead884c4c2980dcf417767b6e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:44.230128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:44.256229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:44.289400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.291251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:44.314918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1017/1998] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:44.333766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.335592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:44.335898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:44.443472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91f57-ad87-4c3b-9ee3-64ed86199131 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:44.445383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644a6a3-331e-46e0-a2d6-6ae1c3f83aee None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:44.449162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:44.449550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:44.449818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.450097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.450362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.450471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.450699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.451074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] PATH_INFO: `/v3/projects/5323341df28843268d971ef3fb8e839e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.452542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5323341df28843268d971ef3fb8e839e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:44.454654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.459767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:44.461235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.485905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1018/1999] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:44.528737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5323341df28843268d971ef3fb8e839e', 'request_id': 'req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.542001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5323341df28843268d971ef3fb8e839e', 'request_id': 'req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.554331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5323341df28843268d971ef3fb8e839e', 'request_id': 'req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.569617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] The token cache is being invalidate because project 5323341df28843268d971ef3fb8e839e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:44.569913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.570633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.576543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 982/2000] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:44 2022] DELETE /identity/v3/projects/5323341df28843268d971ef3fb8e839e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:44.577328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.597716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733541e5-d94b-4570-b6ed-30a316eb5b58 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:44.691588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:44.692917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:44.693204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:44.693540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] PATH_INFO: `/v3/users/2e95841f489b4b17b243ca412649c2e1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:44.695175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e95841f489b4b17b243ca412649c2e1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:44.698236 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:44.752111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e95841f489b4b17b243ca412649c2e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.765432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e95841f489b4b17b243ca412649c2e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.766375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e95841f489b4b17b243ca412649c2e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.774867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e95841f489b4b17b243ca412649c2e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.776324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:44.795169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a6d4f313-0506-4f41-8b55-9f262fd30876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e95841f489b4b17b243ca412649c2e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:44.803870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1019/2001] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:44 2022] DELETE /identity/v3/users/2e95841f489b4b17b243ca412649c2e1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:44.859684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:44.861873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:44.892073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d44f3-f95f-4e30-9a34-ee208aa3ce46 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:45.085253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:45.086313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.086596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.086870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] PATH_INFO: `/v3/users/f3bb0fcbd0934dc2b240734db6fbcb04` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.088356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bb0fcbd0934dc2b240734db6fbcb04)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:45.091434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:45.192316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bb0fcbd0934dc2b240734db6fbcb04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.196973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:45.211022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bb0fcbd0934dc2b240734db6fbcb04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.211702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bb0fcbd0934dc2b240734db6fbcb04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.222833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bb0fcbd0934dc2b240734db6fbcb04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.223683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bb0fcbd0934dc2b240734db6fbcb04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.246847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 983/2002] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:44 2022] DELETE /identity/v3/users/f3bb0fcbd0934dc2b240734db6fbcb04 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:45.248601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.248892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.249219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.272750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:45.276047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:45.315029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:45.316971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:45.427731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1020/2003] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:45.438592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:45.440603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:45.456846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc98c-716a-4de5-a724-623f61b477d2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:45.462003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:45.462939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.463244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.463579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] PATH_INFO: `/v3/projects/283d9e5361a3410ab69423ce53aa77fa` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.464856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283d9e5361a3410ab69423ce53aa77fa)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:45.466792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:45.527928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283d9e5361a3410ab69423ce53aa77fa', 'request_id': 'req-1f8d1432-52f9-410a-bdb9-f5382e37e091'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.534766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b8fc0-63ad-4779-b9b9-4c553b480d94 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:45.536591 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283d9e5361a3410ab69423ce53aa77fa', 'request_id': 'req-1f8d1432-52f9-410a-bdb9-f5382e37e091'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.545262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283d9e5361a3410ab69423ce53aa77fa', 'request_id': 'req-1f8d1432-52f9-410a-bdb9-f5382e37e091'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.557461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] The token cache is being invalidate because project 283d9e5361a3410ab69423ce53aa77fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:45.557822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.558592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1f8d1432-52f9-410a-bdb9-f5382e37e091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:45.560430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 984/2004] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:45 2022] DELETE /identity/v3/projects/283d9e5361a3410ab69423ce53aa77fa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:45.565338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf2fc-bb37-44d1-a0d0-35f85588c931 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.565754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf2fc-bb37-44d1-a0d0-35f85588c931 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.566452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf2fc-bb37-44d1-a0d0-35f85588c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.590540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-01dbf2fc-bb37-44d1-a0d0-35f85588c931 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:45.590540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-01dbf2fc-bb37-44d1-a0d0-35f85588c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:45.593404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:45.594138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.594462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.594869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.598169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:45.649963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:45.672049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 985/2005] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:45.674017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.674813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.675566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.676136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:45.680137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:45.682889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:45.695225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1021/2006] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:45.698603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:45.700214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:45.709530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 986/2007] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:45.714554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:45.727905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16ebdd-5ba8-408b-8e11-25e78d6de277 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:45.735015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:45.735820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.736183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.736595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.737406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:45.737721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:45.739948 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:45.759916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1022/2008] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:45.764534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:45.780301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc796-35e5-4e93-ac16-0ffe88ffaf73 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:45.790307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:45.791327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.791608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.791884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.792617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:45.794947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:45.829629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 987/2009] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:45 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:45.830781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:45.842718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40776b6-8b54-481d-97bb-757abef90e7f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:45.936198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:45.938112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:45.939439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:45.939869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:45.941020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:45.943687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.010957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1023/2010] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:45 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:46.023795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.042134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9868-2476-4189-ae2a-2aeca973cefc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.060520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.060520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.060520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.060520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.061048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.061048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.080515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 988/2011] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:46.084777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.096393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a1883-6ec9-48f8-aabd-9e661dd7a74c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.109688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.110903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.111263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.114788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.115641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.118021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.144414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1024/2012] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:46.149305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.164598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41a7e-0fdf-48f3-9141-9950c39fd98e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.176248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27626a43-e3a6-4634-9e1e-bb5624bc07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.184661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27626a43-e3a6-4634-9e1e-bb5624bc07f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.185001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27626a43-e3a6-4634-9e1e-bb5624bc07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.185296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27626a43-e3a6-4634-9e1e-bb5624bc07f7 admin admin] PATH_INFO: `/v3/projects/068ab0d1760e44928f62e4476b2e5aa3/users/dab40518eecd4159af5969645f40c4f3/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.193547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.195530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:46.237358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27626a43-e3a6-4634-9e1e-bb5624bc07f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068ab0d1760e44928f62e4476b2e5aa3, user_id=dab40518eecd4159af5969645f40c4f3, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.242333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27626a43-e3a6-4634-9e1e-bb5624bc07f7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.245640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28da0-a3d9-48a1-82b0-3a015b9bc0b9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.272709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.273620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.274031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 989/2013] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:46 2022] PUT /identity/v3/projects/068ab0d1760e44928f62e4476b2e5aa3/users/dab40518eecd4159af5969645f40c4f3/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:46.284597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.284930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.285065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] PATH_INFO: `/v3/projects/9b047d68d215495aa00f2816e60ccfd5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.286250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.287408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.296781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b047d68d215495aa00f2816e60ccfd5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.301153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.356087 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] MFA Rules not processed for user `dab40518eecd4159af5969645f40c4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:46.376927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:46.437784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b047d68d215495aa00f2816e60ccfd5', 'request_id': 'req-79038bac-e71f-4130-b52e-104fb10e63a2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:46.448007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b047d68d215495aa00f2816e60ccfd5', 'request_id': 'req-79038bac-e71f-4130-b52e-104fb10e63a2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:46.460767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b047d68d215495aa00f2816e60ccfd5', 'request_id': 'req-79038bac-e71f-4130-b52e-104fb10e63a2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:46.479591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] The token cache is being invalidate because project 9b047d68d215495aa00f2816e60ccfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:46.479880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:46.480650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-79038bac-e71f-4130-b52e-104fb10e63a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:46.485592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1025/2014] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:46 2022] DELETE /identity/v3/projects/9b047d68d215495aa00f2816e60ccfd5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:46.488690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d2a5-7701-4c8e-9dab-553e6dbe07d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.492839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d2a5-7701-4c8e-9dab-553e6dbe07d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.493247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386d2a5-7701-4c8e-9dab-553e6dbe07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.516632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 990/2015] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:46.519749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7386d2a5-7701-4c8e-9dab-553e6dbe07d7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:46.521282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7386d2a5-7701-4c8e-9dab-553e6dbe07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:46.552735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.554583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:46.567303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:46.588300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1026/2016] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:46.598600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.599399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.600395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.625899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:46.627117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:46.634496 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad48a9-6fb4-4521-86c4-6cccb0ad9ca1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.637211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1027/2017] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:46.643386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.661913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d6683-06e5-4c29-ba81-6704b0f46f43 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.670785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.671498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.671781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.672078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.673068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:46.673418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.676351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.695770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:46.708601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1028/2018] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:40:46.710983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.712176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.718031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.718031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.718969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.736271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800738-1eae-4d5c-bdd9-9c2bfdd5021d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.746072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.747465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.747935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.748422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.751004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.753224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.796811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1029/2019] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:46 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:46.798238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.798633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.800630 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.832583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 991/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:40:46.853712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:46.854109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:46.873922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e989c1-c51f-4d1d-a7dc-7e102c9ac9fb service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.944546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1067418-3db9-4cfb-9bcf-6eece9137c9e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:46.955136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.955980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.956264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.958052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.958885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.961974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:46.969187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:46.970210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:46.970491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:46.970760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] PATH_INFO: `/v3/users/dab40518eecd4159af5969645f40c4f3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:46.972032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab40518eecd4159af5969645f40c4f3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:46.974744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.002924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1030/2021] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:46 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:47.014864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:47.026606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d155f0-5ea3-42ca-a62c-f26f6e028799 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:47.037691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:47.038865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.040393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.043847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.050260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:47.055065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.061609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab40518eecd4159af5969645f40c4f3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.074826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1031/2022] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:47.077581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab40518eecd4159af5969645f40c4f3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.078430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab40518eecd4159af5969645f40c4f3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.079582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:47.091941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab40518eecd4159af5969645f40c4f3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.093395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1bbabf88-6c19-4d87-883b-2595217d563b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab40518eecd4159af5969645f40c4f3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.103012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027819c-77fb-4466-954f-15bf8ea22bb0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:47.113542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:47.114438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.114816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.115188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.116070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:47.120397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.134941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 992/2023] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:46 2022] DELETE /identity/v3/users/dab40518eecd4159af5969645f40c4f3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:47.140268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.140663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.141191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.143383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1032/2024] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:47.149018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:47.156549 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:47.178048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:47.181190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:47.184077 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf26a-0c98-4cb8-9851-6f599b1cb6b4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:47.198103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:47.293605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 993/2025] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:47.298213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8679eb-863f-491b-85b6-8934edbffc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:47.299234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8679eb-863f-491b-85b6-8934edbffc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.299584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8679eb-863f-491b-85b6-8934edbffc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.299926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8679eb-863f-491b-85b6-8934edbffc16 admin admin] PATH_INFO: `/v3/projects/ef882a1dbf5041d9bc5926dbbdb29e7a/users/66c0c813f2d24653a3b2dd5557d20998/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.318942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:47.320889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:47.334032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8679eb-863f-491b-85b6-8934edbffc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef882a1dbf5041d9bc5926dbbdb29e7a, user_id=66c0c813f2d24653a3b2dd5557d20998, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:47.337407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8679eb-863f-491b-85b6-8934edbffc16 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.344735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:47.370368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1033/2026] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:47 2022] PUT /identity/v3/projects/ef882a1dbf5041d9bc5926dbbdb29e7a/users/66c0c813f2d24653a3b2dd5557d20998/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:47.375233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.375663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.376082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.406796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:47.408247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:47.430934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d12552-6835-4ba2-83db-4a760be393fc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:47.516242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1034/2027] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:47.529361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:47.531641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:47.596700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:47.597544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.597921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.598204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.626206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:47.627853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.668220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112cf1-de90-4d4f-84cb-16aad6afc6b0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:47.670867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 994/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:47.677551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b373947-147c-4606-be03-a78aaa1cc0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:47.679895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373947-147c-4606-be03-a78aaa1cc0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.680870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373947-147c-4606-be03-a78aaa1cc0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.681246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b373947-147c-4606-be03-a78aaa1cc0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.709507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:47.711285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:47.720594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b373947-147c-4606-be03-a78aaa1cc0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:47.722212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b373947-147c-4606-be03-a78aaa1cc0a8 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.732173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80945a8b-f7d8-44b3-8ba7-7553c7c899b2 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:47.739588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1035/2029] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:47.742631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:47.743623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.743999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.744389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] PATH_INFO: `/v3/users/3adcf21cc9f147ad827bc29254f7f44d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.745749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adcf21cc9f147ad827bc29254f7f44d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:47.747770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:47.829758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adcf21cc9f147ad827bc29254f7f44d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.844248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adcf21cc9f147ad827bc29254f7f44d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.845075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adcf21cc9f147ad827bc29254f7f44d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.855593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adcf21cc9f147ad827bc29254f7f44d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.856338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adcf21cc9f147ad827bc29254f7f44d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:47.861462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:47.899640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:47.900606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:47.901108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:47.911840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 995/2030] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:47 2022] DELETE /identity/v3/users/3adcf21cc9f147ad827bc29254f7f44d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:47.950035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:47.952447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:48.044742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1036/2031] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:48.060240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:48.062521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:48.135457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f08f1-d451-4df6-87cb-23df721aa17a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:48.139318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:48.140151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:48.140565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:48.141031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:48.151874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:48.153272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:48.165498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 996/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:48.916659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:48.919061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:48.944149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c007037-b93e-47dd-9bf0-40f353e78bd5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:48.951076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:48.952595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:48.953299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:48.953754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] PATH_INFO: `/v3/users/b8b728c50b974faa80a428d3a8ee3ebf` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:48.956302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b728c50b974faa80a428d3a8ee3ebf)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:48.959264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.000588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.002284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.022802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d282a6a-f556-4525-9842-a5aee3ff79ed service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:49.035883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:49.036866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.037146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.037418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] PATH_INFO: `/v3/projects/068ab0d1760e44928f62e4476b2e5aa3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.042964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=068ab0d1760e44928f62e4476b2e5aa3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:49.046216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.071964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:49.116433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b728c50b974faa80a428d3a8ee3ebf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.158916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b728c50b974faa80a428d3a8ee3ebf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.160017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b728c50b974faa80a428d3a8ee3ebf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.178260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b728c50b974faa80a428d3a8ee3ebf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.185225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068ab0d1760e44928f62e4476b2e5aa3', 'request_id': 'req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.192968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b728c50b974faa80a428d3a8ee3ebf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.199324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068ab0d1760e44928f62e4476b2e5aa3', 'request_id': 'req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.207916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1037/2033] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:48 2022] DELETE /identity/v3/users/b8b728c50b974faa80a428d3a8ee3ebf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:49.209469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.210822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068ab0d1760e44928f62e4476b2e5aa3', 'request_id': 'req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.212185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.227728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] The token cache is being invalidate because project 068ab0d1760e44928f62e4476b2e5aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:49.228266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.229599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e07808b5-bd1d-46ce-bc24-27ebfe9dfc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.234091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 997/2034] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:48 2022] DELETE /identity/v3/projects/068ab0d1760e44928f62e4476b2e5aa3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:49.236204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52de4b-74ee-4012-a3b2-32b1d806f1a0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.236673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52de4b-74ee-4012-a3b2-32b1d806f1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.237163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52de4b-74ee-4012-a3b2-32b1d806f1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.261089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fb52de4b-74ee-4012-a3b2-32b1d806f1a0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:49.262661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fb52de4b-74ee-4012-a3b2-32b1d806f1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.319925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db4f5-c206-4cf0-8b81-41ea61e31fd7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:49.327641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:49.329239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.329594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.329990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] PATH_INFO: `/v3/projects/790839bfda254d6f810c0ffb2739123d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.332177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790839bfda254d6f810c0ffb2739123d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:49.334377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.338824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 998/2035] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:49.340323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.340785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.341207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.390311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:49.394670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.428817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 999/2036] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:49.428817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.428817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.442484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:49.456970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790839bfda254d6f810c0ffb2739123d', 'request_id': 'req-a5033637-7a5d-41d0-8c61-875015780b64'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.470261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790839bfda254d6f810c0ffb2739123d', 'request_id': 'req-a5033637-7a5d-41d0-8c61-875015780b64'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.485835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790839bfda254d6f810c0ffb2739123d', 'request_id': 'req-a5033637-7a5d-41d0-8c61-875015780b64'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.520336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] The token cache is being invalidate because project 790839bfda254d6f810c0ffb2739123d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:49.523154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.524867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673486fc-e73e-4091-8efa-11d4fb139f3d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:49.525792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5033637-7a5d-41d0-8c61-875015780b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.528941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1038/2037] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:49 2022] DELETE /identity/v3/projects/790839bfda254d6f810c0ffb2739123d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:49.532014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.535368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.535368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.560530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:49.561574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.600617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:49.613129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:49.613808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.614200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.614433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.616568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.665019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1039/2038] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:49.666347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.668952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.691407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a177a-416c-4358-ac7d-a96ccf588685 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:49.705496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:49.711988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.717226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.717645 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] PATH_INFO: `/v3/users/08f4ec70bfdd4e738a0926230170be99` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.720282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f4ec70bfdd4e738a0926230170be99)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:49.722084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.724114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:49.725879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.740686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1000/2039] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:49.750250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.770150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da01c72-57f9-43ba-84ef-e701a4d4e743 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:49.777617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:49.779118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.779588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.780010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.781626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:49.782113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:49.784664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.804465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1001/2040] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:49.806524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.819677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03147871-c298-43a4-8223-82b0bbd22157 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:49.827549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:49.832513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:49.832822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:49.833067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:49.834041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:49.836378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:49.840071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f4ec70bfdd4e738a0926230170be99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.868302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f4ec70bfdd4e738a0926230170be99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.869484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f4ec70bfdd4e738a0926230170be99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.878490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1002/2041] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:49 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:49.881696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:49.884791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f4ec70bfdd4e738a0926230170be99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.888059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:49.902361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f4ec70bfdd4e738a0926230170be99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:49.919512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1040/2042] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:49 2022] DELETE /identity/v3/users/08f4ec70bfdd4e738a0926230170be99 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:49.957696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:49.997263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b85c-141d-4a19-acd8-53642bc786d7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:50.067036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:50.067814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.068076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.068352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.069090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:50.071056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:50.096402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1003/2043] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:49 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:50.099953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:50.110573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2989f0-f357-476c-a9f9-9b39e03b883e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:50.115913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:50.116351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.116663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.116940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.117677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:50.119312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:50.135607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1041/2044] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:50.140026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:50.153021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0bb52-c026-4fd1-8faa-a3ba76b2f6c2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:50.158560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f311-e875-4561-a5a6-601c9320afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:50.159427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f311-e875-4561-a5a6-601c9320afb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.159777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f311-e875-4561-a5a6-601c9320afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.160115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f311-e875-4561-a5a6-601c9320afb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.161467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f311-e875-4561-a5a6-601c9320afb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:50.163902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f311-e875-4561-a5a6-601c9320afb5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:50.180894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1004/2045] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:50.181565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:50.201565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a454a1-46da-4309-a4c2-b314c8cad8b0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:50.210282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:50.211207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.211490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.211765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] PATH_INFO: `/v3/projects/0a0cbd7ed3074a46a1d81a0a3b8b15c4/users/ffa0a22dbeb54d88b93e71d86e0b3c01/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.245084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0cbd7ed3074a46a1d81a0a3b8b15c4, user_id=ffa0a22dbeb54d88b93e71d86e0b3c01, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:50.248380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:50.274433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1042/2046] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:50 2022] PUT /identity/v3/projects/0a0cbd7ed3074a46a1d81a0a3b8b15c4/users/ffa0a22dbeb54d88b93e71d86e0b3c01/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:50.290673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea8d66-d20a-45a3-981d-ad96b0ffe65d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.291188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea8d66-d20a-45a3-981d-ad96b0ffe65d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.291545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea8d66-d20a-45a3-981d-ad96b0ffe65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.346387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-04ea8d66-d20a-45a3-981d-ad96b0ffe65d None None] MFA Rules not processed for user `ffa0a22dbeb54d88b93e71d86e0b3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:50.347593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04ea8d66-d20a-45a3-981d-ad96b0ffe65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:50.389029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:50.392801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:50.509348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1005/2047] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:50.511549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e57db-5fac-40cc-af58-918599317c7b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.511971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e57db-5fac-40cc-af58-918599317c7b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.512745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e57db-5fac-40cc-af58-918599317c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.574975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3b47d-d9fd-4827-a511-9d5499b5838d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:50.580781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-259e57db-5fac-40cc-af58-918599317c7b None None] MFA Rules not processed for user `66c0c813f2d24653a3b2dd5557d20998`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:50.581990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-259e57db-5fac-40cc-af58-918599317c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:50.587569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:50.588540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.588826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.589101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] PATH_INFO: `/v3/projects/68d631c69f3340d5bef1596ddadd72d9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.590484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d631c69f3340d5bef1596ddadd72d9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:50.592427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:50.647019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:50.668628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:50.716299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d631c69f3340d5bef1596ddadd72d9', 'request_id': 'req-f7405ee6-bdd3-4820-a8fb-947faa7c399d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:50.720564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1006/2048] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:50.723615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d631c69f3340d5bef1596ddadd72d9', 'request_id': 'req-f7405ee6-bdd3-4820-a8fb-947faa7c399d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:50.733535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e57db-5fac-40cc-af58-918599317c7b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:50.734190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d631c69f3340d5bef1596ddadd72d9', 'request_id': 'req-f7405ee6-bdd3-4820-a8fb-947faa7c399d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:50.735263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-259e57db-5fac-40cc-af58-918599317c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:50.757466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] The token cache is being invalidate because project 68d631c69f3340d5bef1596ddadd72d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:50.757994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:50.760244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:50.763185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1043/2049] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:50 2022] DELETE /identity/v3/projects/68d631c69f3340d5bef1596ddadd72d9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:50.764793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:50.767162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:50.871650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7405ee6-bdd3-4820-a8fb-947faa7c399d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:50.885644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:50.889096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:50.889408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:50.889679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:50.897078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:50.963350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e57db-5fac-40cc-af58-918599317c7b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:51.067507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:51.071670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:51.073873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:51.074714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.075291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.075586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.078806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:51.096763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1044/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:51.098875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:51.102711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:51.228673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:51.234980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:51.246690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e04e3-b3cc-4e80-9230-6a8cce637aae service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:51.260615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:51.262156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1007/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:51.262685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.263047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.263331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] PATH_INFO: `/v3/users/d6d720f249be4e8780521c707676b589` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.264129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:51.266467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d720f249be4e8780521c707676b589)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:51.268558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:51.272386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:51.281991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:51.306367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5235c-c658-4368-a74d-b64813f50ea0 service glance] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:51.321304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:51.322222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.323102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.323394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] PATH_INFO: `/v3/projects/328c2fc424cb4825ad120e523f596515` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.332242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=328c2fc424cb4825ad120e523f596515)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:51.335215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:51.397265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d720f249be4e8780521c707676b589'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.417592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:51.432298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d720f249be4e8780521c707676b589'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.433219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d720f249be4e8780521c707676b589'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.448756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d720f249be4e8780521c707676b589'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.459457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328c2fc424cb4825ad120e523f596515', 'request_id': 'req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.465318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6e8a18d6-55b0-4b4f-bf57-dc266abc1e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d720f249be4e8780521c707676b589'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.473875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328c2fc424cb4825ad120e523f596515', 'request_id': 'req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.481648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1045/2052] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:51 2022] DELETE /identity/v3/users/d6d720f249be4e8780521c707676b589 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:51.495134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328c2fc424cb4825ad120e523f596515', 'request_id': 'req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.517350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] The token cache is being invalidate because project 328c2fc424cb4825ad120e523f596515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:51.517686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.518389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c6429bd0-3cf6-4962-bd6f-9bf80dd8bd6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:51.520567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1008/2053] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:51 2022] DELETE /identity/v3/projects/328c2fc424cb4825ad120e523f596515 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:51.525793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.526100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.526388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.574747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:51.576217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:51.728520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1046/2054] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:51.733044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.733044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.733357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.765204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:51.766617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:51.781124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1009/2055] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:51.782501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:51.797250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd535762-84a1-4c2d-9528-afc3e46a0ba2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:51.803988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:51.805498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.805834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.806195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.806997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:51.807296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:51.809729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:51.839197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1047/2056] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:51.844403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:51.855870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6229702-3926-48e8-88a0-96a00fa921af None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:51.862171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:51.863018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:51.863472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:51.864012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:51.865671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:51.867777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:51.912685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1010/2057] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:51 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:51.914862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:51.926095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f03472-6479-44b9-98f9-45c947061b42 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:52.092329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:52.093904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.094420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.094956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.096183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:52.102483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:52.142886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:52.155173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1048/2058] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:51 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:52.160233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:52.177934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37052264-f265-4476-9dfd-a23f63e27b37 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:52.186769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:52.187473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.187779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.188031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.188985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:52.195833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:52.217389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1011/2059] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:52.219511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:52.231546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a1ab-9590-44b0-b214-a13347e328dc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:52.239355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d0e3-4494-42ca-97b8-9c2fdbf8eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:52.240521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d0e3-4494-42ca-97b8-9c2fdbf8eec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.242024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d0e3-4494-42ca-97b8-9c2fdbf8eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.242453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d0e3-4494-42ca-97b8-9c2fdbf8eec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.243788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1d0e3-4494-42ca-97b8-9c2fdbf8eec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:52.246002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1d0e3-4494-42ca-97b8-9c2fdbf8eec4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:52.264652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1049/2060] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:52.265899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:52.282008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e89834-eebf-449a-b142-d90060889d57 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:52.294578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:52.295622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.297048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.297436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] PATH_INFO: `/v3/projects/7319d9d4586d496bb45a40f47d9fc409/users/d1d75e6b70ec4f7c9b56d9274df390e7/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.325294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7319d9d4586d496bb45a40f47d9fc409, user_id=d1d75e6b70ec4f7c9b56d9274df390e7, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:52.328635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:52.352346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1012/2061] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:52 2022] PUT /identity/v3/projects/7319d9d4586d496bb45a40f47d9fc409/users/d1d75e6b70ec4f7c9b56d9274df390e7/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:52.358217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.358425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.358709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.388653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:52.398117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:52.450586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:52.452729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:52.504805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1050/2062] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:52.518907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:52.520707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:52.539133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7392974-bf8c-42a5-88a2-4a04fefb9770 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:52.545605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:52.546757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.547211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.547626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] PATH_INFO: `/v3/projects/af1d2db0f8254f81a8aa77f6f0c262db` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.549306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1d2db0f8254f81a8aa77f6f0c262db)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:52.552282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:52.596878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c603865-9725-4cd5-b2cc-3f4ed61e8276 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:52.602970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49241098-96e6-466a-8fcd-5c5e35d09758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:52.603708 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241098-96e6-466a-8fcd-5c5e35d09758 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.603997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241098-96e6-466a-8fcd-5c5e35d09758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.604271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49241098-96e6-466a-8fcd-5c5e35d09758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.617596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49241098-96e6-466a-8fcd-5c5e35d09758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:52.619424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49241098-96e6-466a-8fcd-5c5e35d09758 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:52.636056 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1051/2063] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:52.708343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1d2db0f8254f81a8aa77f6f0c262db', 'request_id': 'req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:52.713702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:52.732818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1d2db0f8254f81a8aa77f6f0c262db', 'request_id': 'req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:52.754039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1d2db0f8254f81a8aa77f6f0c262db', 'request_id': 'req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:52.774636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604584-9021-46fd-9fd6-5bb2b2c1c4c7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.774636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604584-9021-46fd-9fd6-5bb2b2c1c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.774636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604584-9021-46fd-9fd6-5bb2b2c1c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.783819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] The token cache is being invalidate because project af1d2db0f8254f81a8aa77f6f0c262db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:52.784116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:52.787239 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-533c8fc7-9562-4d6b-86de-4fc5ea2cc154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:52.792189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1013/2064] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:52 2022] DELETE /identity/v3/projects/af1d2db0f8254f81a8aa77f6f0c262db => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:52.799401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:52.799832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:52.800172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:52.813344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9d604584-9021-46fd-9fd6-5bb2b2c1c4c7 None None] MFA Rules not processed for user `66c0c813f2d24653a3b2dd5557d20998`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:52.814864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9d604584-9021-46fd-9fd6-5bb2b2c1c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:52.899721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:52.903888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1052/2065] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:52.904787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:53.030478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.030788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.031082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.036573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1014/2066] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:53.056440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:53.057729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:53.079637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1053/2067] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:53.082392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:53.112236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e7dd8-8d28-4ef9-98bb-cfa782e38a96 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:53.125044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:53.125865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.126245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.126539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.128306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:40:53.128655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:53.133860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:53.170623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:53.178933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1015/2068] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:40:53.185989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d49a-c7b0-4ec4-9cf1-c1bcc35beaaa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:53.192280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:53.193169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.193544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.193916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.194825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:53.197924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:53.261647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1054/2069] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:53 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:53.265965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:53.281597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61a0e1-843a-4430-9f2d-69f341a24e9c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:53.455158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:53.456248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.456741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.457121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.458226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:53.461953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:53.509730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1016/2070] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:53 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:53.514081 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:53.529877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f267-9cf3-48ee-9643-7517eed6f187 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:53.545467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:53.547298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.547653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.547938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.548707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:53.551282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:53.553155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:53.574499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1055/2071] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:53.575568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:53.593714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4f5b6-bbba-45fe-a628-56669e3f1deb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:53.604350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77f9df-ed0f-41e7-9dcb-7cd7c070ff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:53.605442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77f9df-ed0f-41e7-9dcb-7cd7c070ff53 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.605720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77f9df-ed0f-41e7-9dcb-7cd7c070ff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.605938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77f9df-ed0f-41e7-9dcb-7cd7c070ff53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.607056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77f9df-ed0f-41e7-9dcb-7cd7c070ff53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:53.612816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77f9df-ed0f-41e7-9dcb-7cd7c070ff53 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:53.628540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1017/2072] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:53.633090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:53.648592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ae6fe-720f-427f-9729-08fdce2ef44f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:53.660816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2b025-da7b-4caf-bfef-723c82f996aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:53.663286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b025-da7b-4caf-bfef-723c82f996aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.663544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b025-da7b-4caf-bfef-723c82f996aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.663885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b025-da7b-4caf-bfef-723c82f996aa admin admin] PATH_INFO: `/v3/projects/b9e623374c274f1fb76adb1935812bc9/users/afd789a298374d8093d51ca5cd894af4/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.693015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2b025-da7b-4caf-bfef-723c82f996aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e623374c274f1fb76adb1935812bc9, user_id=afd789a298374d8093d51ca5cd894af4, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:53.695889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2b025-da7b-4caf-bfef-723c82f996aa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:53.728298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.728650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.728929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.734558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1056/2073] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:53 2022] PUT /identity/v3/projects/b9e623374c274f1fb76adb1935812bc9/users/afd789a298374d8093d51ca5cd894af4/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:53.799260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] MFA Rules not processed for user `afd789a298374d8093d51ca5cd894af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:53.801246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:53.819281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:53.819684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:53.820166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:53.888164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] MFA Rules not processed for user `d1d75e6b70ec4f7c9b56d9274df390e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:53.889482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:53.893135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:54.000067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1018/2074] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:54.001532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.116697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1057/2075] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:54.121632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.125651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:54.226479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8288f6-2ca3-49a6-b0a2-3be9ea4c745e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.233224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.234050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.234335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.234601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.235420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.243628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.275730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198c6c2-0860-4df5-bd22-0c131f699121 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.283121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1058/2076] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:54 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:54.287018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.288101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.288382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.288686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.289483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.291412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.296841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.328519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1019/2077] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:40:54 2022] POST /identity/v3/projects => generated 365 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:54.332796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.353235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:54.380390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc17265-544e-4dc5-b43d-1d69da3fbc39 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.434894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70c8ba-2e9f-4c0d-a19d-80bbf87767be admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.440618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.441243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.441527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.441803 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.442562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.444519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.471535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1020/2078] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:54 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:40:54.473125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.473542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.474695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.474982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.475692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.475826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.478112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.487032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146c3db-ae1c-4583-979c-04f3983b8cd7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.492720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.493503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.493850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.494229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.495012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.496703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.502818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1059/2079] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:40:54 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:40:54.507204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.510176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1021/2080] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:54.514621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.518442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e898c0-5bf5-45d0-ac31-afa80f25c2f8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.528755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.529450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.530000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.530000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.530727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.530926 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f549-d3ce-4f90-900f-2fa88c0e5714 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.532375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.537148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.538433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.538721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.538997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] PATH_INFO: `/v3/projects/1bbe1f42bd70498caf06c5cada9ea3f5/users/058521c98f7e4ff7a6efc2058cb04084/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.544537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1060/2081] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:54.549918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.557656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbe1f42bd70498caf06c5cada9ea3f5, user_id=058521c98f7e4ff7a6efc2058cb04084, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.560885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4729a2-90dc-431b-831e-17e0babee1bc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.561280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.566786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.571369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.571656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.571938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] PATH_INFO: `/v3/projects/77bf17b71ef543cb8b6558023abb63ff/users/0ccf2e9ecac44b21b6858651090228a3/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.577774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1022/2082] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:54 2022] PUT /identity/v3/projects/1bbe1f42bd70498caf06c5cada9ea3f5/users/058521c98f7e4ff7a6efc2058cb04084/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:54.581707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.592772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bf17b71ef543cb8b6558023abb63ff, user_id=0ccf2e9ecac44b21b6858651090228a3, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.596620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.600406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:54.615870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1061/2083] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:54 2022] PUT /identity/v3/projects/77bf17b71ef543cb8b6558023abb63ff/users/0ccf2e9ecac44b21b6858651090228a3/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:54.616771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.663836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980af30-55c5-456d-89f1-975356b7fd9f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.694279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792395b-437b-440b-a3ba-fc658c3a4001 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.699412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.699973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.700261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.700576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.701384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.703044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.717062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1062/2084] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:40:54.718469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.723072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.723821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.724104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.724380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.725170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.726766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.728867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89640ee3-1a57-4365-89f6-22bfa26a92e9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.734830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99609da3-322c-4f38-9a60-346c9d5364e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.736142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99609da3-322c-4f38-9a60-346c9d5364e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.736518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99609da3-322c-4f38-9a60-346c9d5364e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.736872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99609da3-322c-4f38-9a60-346c9d5364e9 admin admin] PATH_INFO: `/v3/projects/77bf17b71ef543cb8b6558023abb63ff/users/0ccf2e9ecac44b21b6858651090228a3/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.738542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1023/2085] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:40:54.739719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99609da3-322c-4f38-9a60-346c9d5364e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bf17b71ef543cb8b6558023abb63ff, user_id=0ccf2e9ecac44b21b6858651090228a3, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.742486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99609da3-322c-4f38-9a60-346c9d5364e9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.745551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.753844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1063/2086] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:54 2022] PUT /identity/v3/projects/77bf17b71ef543cb8b6558023abb63ff/users/0ccf2e9ecac44b21b6858651090228a3/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:40:54.758286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547578e-6dc3-4b2f-872d-92f27e4bb70c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:54.824223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:54.825200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.825492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.825768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] PATH_INFO: `/v3/projects/1bbe1f42bd70498caf06c5cada9ea3f5/users/058521c98f7e4ff7a6efc2058cb04084/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.827789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbe1f42bd70498caf06c5cada9ea3f5, user_id=058521c98f7e4ff7a6efc2058cb04084, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:54.830477 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:54.843990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1024/2087] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:40:54 2022] PUT /identity/v3/projects/1bbe1f42bd70498caf06c5cada9ea3f5/users/058521c98f7e4ff7a6efc2058cb04084/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:54.854993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:54.855290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:54.855617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:54.884142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] MFA Rules not processed for user `058521c98f7e4ff7a6efc2058cb04084`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:54.885602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:54.905410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:54.973492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1064/2088] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:54.985669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:54.987522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:55.047446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fb578-be0a-4582-8b08-74d5eedcff6f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:55.052254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a1bf2-20fa-424f-9c94-7f19730b73e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:55.052976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1bf2-20fa-424f-9c94-7f19730b73e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:55.053257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1bf2-20fa-424f-9c94-7f19730b73e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:55.053530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1bf2-20fa-424f-9c94-7f19730b73e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:55.066040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:55.068625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a1bf2-20fa-424f-9c94-7f19730b73e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:55.070168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a1bf2-20fa-424f-9c94-7f19730b73e3 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:55.093164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1025/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:55.219833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:55.251711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f4e50-0eac-485e-bc60-0289f4192197 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:55.266648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889da4-8e3a-40a0-9464-b77ff43418b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:55.267777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889da4-8e3a-40a0-9464-b77ff43418b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:55.268215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889da4-8e3a-40a0-9464-b77ff43418b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:55.268827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889da4-8e3a-40a0-9464-b77ff43418b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:55.416424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53889da4-8e3a-40a0-9464-b77ff43418b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:55.418636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53889da4-8e3a-40a0-9464-b77ff43418b6 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:55.430781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1065/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:56.170987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:56.171553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:56.171553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:56.204403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] MFA Rules not processed for user `0ccf2e9ecac44b21b6858651090228a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:56.205921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:56.288365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1026/2091] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:40:56.298988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:56.299474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:56.299575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:56.318383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] MFA Rules not processed for user `d1d75e6b70ec4f7c9b56d9274df390e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:56.319607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:56.378825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1066/2092] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:56.390059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:56.391585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:56.490467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c867-f97d-456f-8a74-220d51cf069a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:56.495868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5176cb0-6c6d-4619-b9a9-593ab4f949c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:56.497300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176cb0-6c6d-4619-b9a9-593ab4f949c7 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:56.497830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176cb0-6c6d-4619-b9a9-593ab4f949c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:56.498370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5176cb0-6c6d-4619-b9a9-593ab4f949c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:56.508270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176cb0-6c6d-4619-b9a9-593ab4f949c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:56.510380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5176cb0-6c6d-4619-b9a9-593ab4f949c7 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:56.521192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1027/2093] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:58.022627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:58.024416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:58.119899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913af45-d6bc-44d1-92e2-a2985559ec17 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:58.124619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:58.125564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:58.125906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:58.126244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] PATH_INFO: `/v3/users/fc5f8ead884c4c2980dcf417767b6e97` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:58.127506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5f8ead884c4c2980dcf417767b6e97)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:58.131224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:58.131473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:58.190558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5f8ead884c4c2980dcf417767b6e97'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:58.212453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5f8ead884c4c2980dcf417767b6e97'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:58.214216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5f8ead884c4c2980dcf417767b6e97'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:58.227108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5f8ead884c4c2980dcf417767b6e97'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:58.235738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5f8ead884c4c2980dcf417767b6e97'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:58.246160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1067/2094] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:40:58 2022] DELETE /identity/v3/users/fc5f8ead884c4c2980dcf417767b6e97 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:40:58.250640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:58.251683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:58.251683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:58.277017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:40:58.279191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:58.379856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1028/2095] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:40:58.413279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:58.415672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:58.491709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478208a7-5b22-4344-9b57-1e2e0c78c1b8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:58.501798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece675dc-280b-486f-80c7-1ddb3765bd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:58.502989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece675dc-280b-486f-80c7-1ddb3765bd95 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:58.502989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece675dc-280b-486f-80c7-1ddb3765bd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:58.503213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece675dc-280b-486f-80c7-1ddb3765bd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:58.514763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece675dc-280b-486f-80c7-1ddb3765bd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:58.517762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece675dc-280b-486f-80c7-1ddb3765bd95 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:58.531750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1068/2096] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:40:59.884774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:40:59.886790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:40:59.899914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451e57a-5458-4d1f-939f-e7bc25c7517d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:40:59.907429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:40:59.908392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:40:59.908768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:40:59.909107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] PATH_INFO: `/v3/projects/da58fa0a837d45c7bba43ec3dd932dfa` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:40:59.910385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da58fa0a837d45c7bba43ec3dd932dfa)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:40:59.912855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:40:59.914711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:40:59.968662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da58fa0a837d45c7bba43ec3dd932dfa', 'request_id': 'req-22d28126-8632-48e3-a2bf-a9d2d62286e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:59.977137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da58fa0a837d45c7bba43ec3dd932dfa', 'request_id': 'req-22d28126-8632-48e3-a2bf-a9d2d62286e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:59.983687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da58fa0a837d45c7bba43ec3dd932dfa', 'request_id': 'req-22d28126-8632-48e3-a2bf-a9d2d62286e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:59.995610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] The token cache is being invalidate because project da58fa0a837d45c7bba43ec3dd932dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:40:59.995897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:59.996572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-22d28126-8632-48e3-a2bf-a9d2d62286e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:40:59.998391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1029/2097] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:40:59 2022] DELETE /identity/v3/projects/da58fa0a837d45c7bba43ec3dd932dfa => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:00.003977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.004547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.005087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.023633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:00.025396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:00.090355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1069/2098] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:00.098204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.098489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.098784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.117343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:00.118557 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:00.126695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1030/2099] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:00.131164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.143208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7270f2-3851-420e-a2e2-ba558794d9cc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.148406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.149136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.149415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.149688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.150475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:00.150727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.152382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.166603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1070/2100] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:41:00.170981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.182331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b55277-42b9-447f-ac26-bd26c206bc3d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.187409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.188155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.188671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.189014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.189812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.191919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.220765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1031/2101] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:00 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:00.225346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.236680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f338f8-9c0b-45f6-a95e-c2e52368cb54 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.241526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:00.303977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.304697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.304976 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.305250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.306223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.308272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.345556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1071/2102] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:00 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:00.347393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.358291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a663e-6a00-4636-9ca4-e5638a21998b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.363473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.364337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.364770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.365137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.366651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.368677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.380675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1032/2103] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:00.385084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.396155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599443d3-f5f0-48b5-98e6-18d747e90e1d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.401217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f53969-1afe-4bbd-9434-fb9f52077ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.401839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53969-1afe-4bbd-9434-fb9f52077ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.402119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53969-1afe-4bbd-9434-fb9f52077ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.402380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f53969-1afe-4bbd-9434-fb9f52077ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.403291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f53969-1afe-4bbd-9434-fb9f52077ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.404974 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f53969-1afe-4bbd-9434-fb9f52077ed9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.423325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1072/2104] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:00.427823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.448620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eab2f-e79b-4604-afba-f3f3fa4bb513 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.454751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.455691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.455967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.456242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] PATH_INFO: `/v3/projects/cbb341cc293742cf956fed850e766cd4/users/d3811885787f440ebbaeb2acc54b337a/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.474931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb341cc293742cf956fed850e766cd4, user_id=d3811885787f440ebbaeb2acc54b337a, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.477789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.497000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1033/2105] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:00 2022] PUT /identity/v3/projects/cbb341cc293742cf956fed850e766cd4/users/d3811885787f440ebbaeb2acc54b337a/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:00.508280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.508682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.509102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.539722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] MFA Rules not processed for user `d3811885787f440ebbaeb2acc54b337a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:00.541141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:00.629703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1073/2106] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:00.642629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:00.644607 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:00.724363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becb69b-06bb-45be-a4d3-106efe3e22e2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:00.729085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a72906-b2c8-439c-8b97-fa491bc650c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:00.729085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72906-b2c8-439c-8b97-fa491bc650c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:00.729338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72906-b2c8-439c-8b97-fa491bc650c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:00.729812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a72906-b2c8-439c-8b97-fa491bc650c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:00.740924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a72906-b2c8-439c-8b97-fa491bc650c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:00.743212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a72906-b2c8-439c-8b97-fa491bc650c6 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:00.755656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1034/2107] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:01.975566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:01.977072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:02.055049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e5dbc-12d5-4f14-a851-803b9ff6912e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:02.061012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:02.062115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:02.062545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:02.062930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] PATH_INFO: `/v3/users/afd789a298374d8093d51ca5cd894af4` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:02.064744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd789a298374d8093d51ca5cd894af4)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:02.067109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:02.091989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:02.170195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd789a298374d8093d51ca5cd894af4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:02.196066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd789a298374d8093d51ca5cd894af4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:02.196873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd789a298374d8093d51ca5cd894af4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:02.209522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd789a298374d8093d51ca5cd894af4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:02.219155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd789a298374d8093d51ca5cd894af4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:02.226646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1074/2108] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:01 2022] DELETE /identity/v3/users/afd789a298374d8093d51ca5cd894af4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:02.231240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:02.231734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:02.231825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:02.255022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:02.256235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:02.285910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:02.331072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1035/2109] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:02.340685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:02.342192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:02.430396 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9be1e-976a-41a5-88de-99720bec95cf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:02.440811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:02.441694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:02.443680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:02.443884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:02.458348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:02.459856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:02.480587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1075/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:02.906611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:02.908933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:02.941872 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4577-2f22-44ec-aefb-1016b5c7129f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:02.953123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:02.954155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:02.956444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:02.956893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] PATH_INFO: `/v3/projects/b9e623374c274f1fb76adb1935812bc9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:02.959180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e623374c274f1fb76adb1935812bc9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:02.961435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:03.028779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e623374c274f1fb76adb1935812bc9', 'request_id': 'req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.040771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e623374c274f1fb76adb1935812bc9', 'request_id': 'req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.050902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e623374c274f1fb76adb1935812bc9', 'request_id': 'req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.063836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] The token cache is being invalidate because project b9e623374c274f1fb76adb1935812bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:03.064161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.064892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.071743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1036/2111] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:02 2022] DELETE /identity/v3/projects/b9e623374c274f1fb76adb1935812bc9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:03.072941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:03.089114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb0ed0-e274-4810-96cb-f9e83b94c7e9 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:03.183351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:03.184659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:03.185084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:03.185817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] PATH_INFO: `/v3/users/058521c98f7e4ff7a6efc2058cb04084` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:03.187556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058521c98f7e4ff7a6efc2058cb04084)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:03.190008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:03.249623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:03.261308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058521c98f7e4ff7a6efc2058cb04084'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.303589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058521c98f7e4ff7a6efc2058cb04084'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.304737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058521c98f7e4ff7a6efc2058cb04084'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.319435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058521c98f7e4ff7a6efc2058cb04084'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.330592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8baef46f-0bd8-4894-8154-29b426c7db64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058521c98f7e4ff7a6efc2058cb04084'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.342419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1076/2112] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:03 2022] DELETE /identity/v3/users/058521c98f7e4ff7a6efc2058cb04084 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:03.776019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:03.782032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:03.796412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3c63-4e37-4600-bfaf-3debf9f56fdc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:03.862212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:03.863030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:03.863334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:03.863650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] PATH_INFO: `/v3/projects/1bbe1f42bd70498caf06c5cada9ea3f5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:03.864869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbe1f42bd70498caf06c5cada9ea3f5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:03.866793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:03.924067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbe1f42bd70498caf06c5cada9ea3f5', 'request_id': 'req-5ee0414e-9d25-4d2c-8424-f898085c429f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.927724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:03.933575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbe1f42bd70498caf06c5cada9ea3f5', 'request_id': 'req-5ee0414e-9d25-4d2c-8424-f898085c429f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.942621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbe1f42bd70498caf06c5cada9ea3f5', 'request_id': 'req-5ee0414e-9d25-4d2c-8424-f898085c429f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.954071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] The token cache is being invalidate because project 1bbe1f42bd70498caf06c5cada9ea3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:03.954358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.955026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ee0414e-9d25-4d2c-8424-f898085c429f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:03.956613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1037/2113] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:03 2022] DELETE /identity/v3/projects/1bbe1f42bd70498caf06c5cada9ea3f5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:03.961752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:03.962118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:03.962469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:03.983183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:03.985054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.069174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1077/2114] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:04.077802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.078111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.078455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.105105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:04.106331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.115887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1038/2115] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:04.120313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.138602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea6ab-9254-4984-937c-3623559eb630 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.147165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.147956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.148349 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.148739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.149572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:04.150480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.151721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.164863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1078/2116] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:41:04.169226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.178669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d0bf2-f592-4344-ab85-3f235204a879 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.184055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef81c7d-8a2b-4b94-a6a7-68a36a65d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.184747 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef81c7d-8a2b-4b94-a6a7-68a36a65d021 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.185029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef81c7d-8a2b-4b94-a6a7-68a36a65d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.185320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef81c7d-8a2b-4b94-a6a7-68a36a65d021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.186233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef81c7d-8a2b-4b94-a6a7-68a36a65d021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.188413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef81c7d-8a2b-4b94-a6a7-68a36a65d021 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.219321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1039/2117] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:04.223887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.236960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239078-fb0e-4fc9-8566-69f8b49d9c5c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.240223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d640ce-e5e2-46fe-8bea-00ee64ac59a1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.240521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d640ce-e5e2-46fe-8bea-00ee64ac59a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.240813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d640ce-e5e2-46fe-8bea-00ee64ac59a1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.242632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1040/2118] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 05:41:04.273372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.274327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.275650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.328901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.329612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.329888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.330559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.332491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.336888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.340724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:04.342822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.377478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1079/2119] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:04.378788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.389218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734826-43b4-4588-8c45-35603893e487 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.396122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.396853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.397170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.397636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.398975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.401538 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.422072 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1080/2120] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:04.423280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.430391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.444672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127afbf7-2705-4a8c-97f9-4c00a20e1558 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.449576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.450552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.450997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.451278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] PATH_INFO: `/v3/users/9ce69882676b4844a1feeb810a09760b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.452574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce69882676b4844a1feeb810a09760b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.454604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.464986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1041/2121] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:04.465856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.477518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:04.479255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a070a6-348c-4a57-bbff-d9ac47b3764e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.486590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.487399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.487748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.488085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.488930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.491009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.506038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1042/2122] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:04.507109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.508835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.509791 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce69882676b4844a1feeb810a09760b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.530220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce69882676b4844a1feeb810a09760b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.531138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce69882676b4844a1feeb810a09760b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.539426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2a801-e7d6-49f5-ae55-ee76106849fc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.541535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce69882676b4844a1feeb810a09760b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.546199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.548046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.552891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.553167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.556273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce69882676b4844a1feeb810a09760b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.557719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.570863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1081/2123] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:04 2022] DELETE /identity/v3/users/9ce69882676b4844a1feeb810a09760b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:04.575916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.578238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.589830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.591837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7292c0f-3cbd-4422-b940-047b63918813 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.632518 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1043/2124] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:04.670192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653bfa0-9d25-4454-a287-141659313de8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.679078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.680519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.680810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.681153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] PATH_INFO: `/v3/projects/2944d4795cfd4fffb98cc19d6442eb3c/users/955fe2b7083a4135abbd54e1e0892d0b/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.701018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2944d4795cfd4fffb98cc19d6442eb3c, user_id=955fe2b7083a4135abbd54e1e0892d0b, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.704233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.732071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1082/2125] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:04 2022] PUT /identity/v3/projects/2944d4795cfd4fffb98cc19d6442eb3c/users/955fe2b7083a4135abbd54e1e0892d0b/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:04.734302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.734695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.735137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.775926 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] MFA Rules not processed for user `955fe2b7083a4135abbd54e1e0892d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:04.777461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.829804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.831657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:04.862997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1044/2126] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:04.867699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.886241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:04.901961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2361f-0cc3-427f-a231-8fc19740ea9e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.906722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.907585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.907857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.908150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] PATH_INFO: `/v3/projects/eaf8c8efda534512ab3d8c7f976a935e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.909362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf8c8efda534512ab3d8c7f976a935e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.911369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.934321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:04.934953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ad7ac-fc5d-4439-83e9-768d23a99b8e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:04.939899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:04.940731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.941078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.941326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:04.942111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:04.944035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:04.960971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf8c8efda534512ab3d8c7f976a935e', 'request_id': 'req-21b6b587-4c13-4bc9-8620-5bb3be6d9400'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.967033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf8c8efda534512ab3d8c7f976a935e', 'request_id': 'req-21b6b587-4c13-4bc9-8620-5bb3be6d9400'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.972260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1045/2127] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:04.974993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf8c8efda534512ab3d8c7f976a935e', 'request_id': 'req-21b6b587-4c13-4bc9-8620-5bb3be6d9400'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.977191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:04.987781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] The token cache is being invalidate because project eaf8c8efda534512ab3d8c7f976a935e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:04.988066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.988916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21b6b587-4c13-4bc9-8620-5bb3be6d9400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:04.990517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1083/2128] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:04 2022] DELETE /identity/v3/projects/eaf8c8efda534512ab3d8c7f976a935e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:04.995859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6bc6b-5ec7-4c7d-a874-6f1adb6e924b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:04.996118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6bc6b-5ec7-4c7d-a874-6f1adb6e924b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:04.996393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6bc6b-5ec7-4c7d-a874-6f1adb6e924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.020759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f1c6bc6b-5ec7-4c7d-a874-6f1adb6e924b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:05.022001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f1c6bc6b-5ec7-4c7d-a874-6f1adb6e924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.045676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594ccc6-956a-4abc-ab91-cddc09d0b4b4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.051279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.052218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.052693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.053058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.054083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.056877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.084555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1046/2129] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:05.085674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.087356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.094614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1084/2130] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:05.098097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.098385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.098667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.107587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7887-0b77-43c3-8d3a-62b0162a8d28 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.112210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.112916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.113197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.113506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.114246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.115826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.117738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:05.118971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.126894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1085/2131] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:05.128640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1047/2132] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:05.131145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.133450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.140537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be7f8e-39aa-4335-b258-e151b2aa2c97 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.143505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a542d-6894-494c-85cd-ad7bff3f4bbc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.145234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.146039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.146327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.146662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.147474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:05.147781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.149482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.153512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.154526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.154869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.155329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] PATH_INFO: `/v3/projects/e0447d95bfa54a78b045183d62f9c578/users/885436f0b6f742eba5ea75abce189d40/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.163925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1086/2133] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:41:05.168114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.172409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0447d95bfa54a78b045183d62f9c578, user_id=885436f0b6f742eba5ea75abce189d40, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.175141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.178273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc14a7-39a8-4af3-adf3-51f6017e2b63 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.185635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.186307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.186593 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.186868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.187565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.189532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.191563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1048/2134] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:05 2022] PUT /identity/v3/projects/e0447d95bfa54a78b045183d62f9c578/users/885436f0b6f742eba5ea75abce189d40/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:05.195612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.222946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1087/2135] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:05 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:05.224151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.265736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:05.274170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57145e-4b60-4b83-8a8d-c2371f3dc870 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.296395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750dd74-b85d-44f2-8391-0094ee3359f5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.301246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.301918 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.302198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.302822 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.303325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.305376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.322573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:05.330875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1088/2136] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:05 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:05.336082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.345051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.346646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.347402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.347939 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73d849-3fad-46a8-9a86-24b795f60d3e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.352729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.353467 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.353712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.353982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.354737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.356343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.356942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.357770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.359482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.372261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1089/2137] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:05.372653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1049/2138] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:05.374269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.375501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.386946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c029-7a5d-4a38-b515-98eb3c0b06b7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.387539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f939ac9-91ba-4004-89b9-c1e48ef9205e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.391905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43b56-3aac-43e7-b33a-2eea70793d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.392761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43b56-3aac-43e7-b33a-2eea70793d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.393038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43b56-3aac-43e7-b33a-2eea70793d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.393309 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43b56-3aac-43e7-b33a-2eea70793d4a admin admin] PATH_INFO: `/v3/projects/e0447d95bfa54a78b045183d62f9c578/users/885436f0b6f742eba5ea75abce189d40/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.393869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.394760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.395188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.395429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43b56-3aac-43e7-b33a-2eea70793d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0447d95bfa54a78b045183d62f9c578, user_id=885436f0b6f742eba5ea75abce189d40, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.395773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.396683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.398116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43b56-3aac-43e7-b33a-2eea70793d4a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.398760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.415135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1090/2139] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:05.416115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.420842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1050/2140] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:05 2022] PUT /identity/v3/projects/e0447d95bfa54a78b045183d62f9c578/users/885436f0b6f742eba5ea75abce189d40/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:05.428751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001980bf-36f5-4ae7-b72a-d55c185127be admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.431637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.431946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.432288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.460427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] MFA Rules not processed for user `885436f0b6f742eba5ea75abce189d40`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:05.461668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.498471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f6a73-4774-4b73-92db-06337cfebeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.499464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6a73-4774-4b73-92db-06337cfebeca admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.499790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6a73-4774-4b73-92db-06337cfebeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.500125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f6a73-4774-4b73-92db-06337cfebeca admin admin] PATH_INFO: `/v3/projects/9e13120638fb4258854b78ed1d3d7cdc/users/880de431d70d4b35af04a043d7359661/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.514736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f6a73-4774-4b73-92db-06337cfebeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e13120638fb4258854b78ed1d3d7cdc, user_id=880de431d70d4b35af04a043d7359661, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.517671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f6a73-4774-4b73-92db-06337cfebeca admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.534083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1091/2141] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:05 2022] PUT /identity/v3/projects/9e13120638fb4258854b78ed1d3d7cdc/users/880de431d70d4b35af04a043d7359661/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:05.540312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.541037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.541324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.545706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1051/2142] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:05.560887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.561100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:05.561200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.561287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.624355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269202f6-7abf-4c11-a4df-bb9e3a430b41 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.625494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1092/2143] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:05.637087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.638574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.650709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:05.695601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.696302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.696615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.696892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.707235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d42712-a20e-4e70-aa28-775d2a7df921 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.710951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.711602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.711882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.712152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.722070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.723597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.735605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1093/2144] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:41:05.780192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.781905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.796068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1052/2145] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:41:05.848633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:05.850537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.858677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:05.865733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267e1c6-e9d4-4874-9d1b-5109a82437ba service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:05.874213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:05.875033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:05.875409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:05.875954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:05.877970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:05.944570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:05.946305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26b2e-4050-43c6-8b8e-b4ce71898bdd service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:05.956295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1094/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:10.041498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:10.043513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:10.074467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96732a71-c694-455f-a078-6f70f031b003 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:10.087755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:10.090323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:10.092252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:10.094604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] PATH_INFO: `/v3/users/ffa0a22dbeb54d88b93e71d86e0b3c01` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:10.097723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa0a22dbeb54d88b93e71d86e0b3c01)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:10.100359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:10.242385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa0a22dbeb54d88b93e71d86e0b3c01'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.264281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa0a22dbeb54d88b93e71d86e0b3c01'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.265238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa0a22dbeb54d88b93e71d86e0b3c01'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.279177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa0a22dbeb54d88b93e71d86e0b3c01'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.293104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa0a22dbeb54d88b93e71d86e0b3c01'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.348130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1053/2147] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:10 2022] DELETE /identity/v3/users/ffa0a22dbeb54d88b93e71d86e0b3c01 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:10.350136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:10.350990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:10.351522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:10.404342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:10.406514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:10.417849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:10.419108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:10.521583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:10.560248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e010d4-c867-4c21-8891-6ae7540afe8d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:10.572511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:10.575885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:10.576372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:10.579010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] PATH_INFO: `/v3/users/955fe2b7083a4135abbd54e1e0892d0b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:10.584400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955fe2b7083a4135abbd54e1e0892d0b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:10.591117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:10.600766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1095/2148] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:10.617657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:10.619340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:10.698062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955fe2b7083a4135abbd54e1e0892d0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.720433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe455d7-0a91-4959-a371-f131ea8382d0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:10.726392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955fe2b7083a4135abbd54e1e0892d0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.727376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955fe2b7083a4135abbd54e1e0892d0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.729184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:10.734504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:10.734949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:10.735193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:10.738655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955fe2b7083a4135abbd54e1e0892d0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.739619 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e93f37e8-f7fe-4f10-8df2-3610fecbbe67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955fe2b7083a4135abbd54e1e0892d0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:10.753906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:10.764292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:10.772084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1054/2149] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:10 2022] DELETE /identity/v3/users/955fe2b7083a4135abbd54e1e0892d0b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:10.784230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1096/2150] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:10.790798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:10.791817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:10.792307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:10.843840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:10.849253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:11.073743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1055/2151] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:11.087703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:11.090798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:11.110415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb3d57-bb5d-467d-b5d2-58179d5e295c service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:11.215423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:11.227649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cbc9a-335c-4e32-bac1-a7fb84abd1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:11.229024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cbc9a-335c-4e32-bac1-a7fb84abd1ed service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.229690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cbc9a-335c-4e32-bac1-a7fb84abd1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.231517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cbc9a-335c-4e32-bac1-a7fb84abd1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.254797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cbc9a-335c-4e32-bac1-a7fb84abd1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:11.256460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cbc9a-335c-4e32-bac1-a7fb84abd1ed service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:11.282647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1097/2152] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:11.401672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:11.414773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:11.458979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d22851-53e9-4a3d-a317-84f5fad591a3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:11.465436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:11.466475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.466769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.467050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] PATH_INFO: `/v3/projects/0a0cbd7ed3074a46a1d81a0a3b8b15c4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.468528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0cbd7ed3074a46a1d81a0a3b8b15c4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:11.470689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:11.564972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0cbd7ed3074a46a1d81a0a3b8b15c4', 'request_id': 'req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:11.584119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0cbd7ed3074a46a1d81a0a3b8b15c4', 'request_id': 'req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:11.624270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0cbd7ed3074a46a1d81a0a3b8b15c4', 'request_id': 'req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:11.627543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:11.645121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] The token cache is being invalidate because project 0a0cbd7ed3074a46a1d81a0a3b8b15c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:11.645415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:11.646070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bdb0bf9b-5df4-494a-90fe-58b5a9135a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:11.650931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1056/2153] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:11 2022] DELETE /identity/v3/projects/0a0cbd7ed3074a46a1d81a0a3b8b15c4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:11.652677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e57c-e219-4d81-8aff-b5a02c823b02 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.653183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e57c-e219-4d81-8aff-b5a02c823b02 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.653274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e57c-e219-4d81-8aff-b5a02c823b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.709145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3f57e57c-e219-4d81-8aff-b5a02c823b02 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:11.710839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3f57e57c-e219-4d81-8aff-b5a02c823b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:11.801890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1098/2154] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:11.811112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.811541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.813453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.834432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:11.835746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:11.843436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.843757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.844040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.857065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1057/2155] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:11.861251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:11.875719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22093b8-d7f5-4697-991f-a0909071ec5c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:11.883341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:11.884676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.885293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.885684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.886540 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:11.887431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:11.889030 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:11.890797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] MFA Rules not processed for user `880de431d70d4b35af04a043d7359661`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:11.892295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:11.933859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1058/2156] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:41:11.935310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:11.947064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d668-7560-4919-bea4-5aab17e27b20 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:11.952325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:11.953727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:11.954144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:11.954667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:11.955553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:11.962255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.010497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1059/2157] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:11 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:12.011869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.013881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.028562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1099/2158] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:12.029737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.049294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64698e-3e63-4782-b84f-69a48a8be73d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.102502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30b606-fb71-4cb7-9c8e-3dc783005553 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.107301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.108287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.108665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.109040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] PATH_INFO: `/v3/projects/2944d4795cfd4fffb98cc19d6442eb3c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.110374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2944d4795cfd4fffb98cc19d6442eb3c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.112727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.139618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a69e91-fdab-4e28-9ef7-2e8b6150285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.140314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69e91-fdab-4e28-9ef7-2e8b6150285b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.140805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69e91-fdab-4e28-9ef7-2e8b6150285b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.141090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69e91-fdab-4e28-9ef7-2e8b6150285b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.141933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a69e91-fdab-4e28-9ef7-2e8b6150285b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.144667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a69e91-fdab-4e28-9ef7-2e8b6150285b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.165990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2944d4795cfd4fffb98cc19d6442eb3c', 'request_id': 'req-517298d5-3847-4f09-81af-e7d0bd8f514a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.168669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1100/2159] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:12 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:12.173896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.174203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.174584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.176368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2944d4795cfd4fffb98cc19d6442eb3c', 'request_id': 'req-517298d5-3847-4f09-81af-e7d0bd8f514a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.184351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2944d4795cfd4fffb98cc19d6442eb3c', 'request_id': 'req-517298d5-3847-4f09-81af-e7d0bd8f514a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.188122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:12.194559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] MFA Rules not processed for user `880de431d70d4b35af04a043d7359661`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:12.196556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] The token cache is being invalidate because project 2944d4795cfd4fffb98cc19d6442eb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:12.196850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.197351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.197579 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.199171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1060/2160] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:12 2022] DELETE /identity/v3/projects/2944d4795cfd4fffb98cc19d6442eb3c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:12.199932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.201198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.247673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:12.274080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1101/2161] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:12.275458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.276949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.281341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517298d5-3847-4f09-81af-e7d0bd8f514a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.286436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.289268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.289565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.290117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.290712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.291805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccd43f-f281-455a-9ca9-f98d2d3ad54a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.292361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.296858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.297824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.298163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.298495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] PATH_INFO: `/v3/users/885436f0b6f742eba5ea75abce189d40` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.299783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885436f0b6f742eba5ea75abce189d40)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.302150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.308139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1061/2162] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:12.308139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.309668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.370136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885436f0b6f742eba5ea75abce189d40'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.383586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885436f0b6f742eba5ea75abce189d40'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.385179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885436f0b6f742eba5ea75abce189d40'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.403863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885436f0b6f742eba5ea75abce189d40'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.413875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885436f0b6f742eba5ea75abce189d40'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:12.418821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b138a-fc40-4dfd-a821-772189143e26 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.422888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1102/2163] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:12 2022] DELETE /identity/v3/users/885436f0b6f742eba5ea75abce189d40 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:12.425231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.426783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.550553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6b34-4c41-4d67-a8ba-dc725e4ebad5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.556296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.557202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.557531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.557816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.558388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.558565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.559309 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.559597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.559874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.560319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.564004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.577663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1103/2164] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:12.578824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.601002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ac7a-8606-474d-8eb2-d89c69604b9f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.606588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad11a6-2a56-46b7-9dab-c3a348f98fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.607652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad11a6-2a56-46b7-9dab-c3a348f98fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.608416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad11a6-2a56-46b7-9dab-c3a348f98fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.608911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad11a6-2a56-46b7-9dab-c3a348f98fd4 admin admin] PATH_INFO: `/v3/projects/7d092186420e4390aa6b6c95ea2abe08/users/a7e1952279d048e0b8aa47037b127627/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.630790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad11a6-2a56-46b7-9dab-c3a348f98fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d092186420e4390aa6b6c95ea2abe08, user_id=a7e1952279d048e0b8aa47037b127627, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.634344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad11a6-2a56-46b7-9dab-c3a348f98fd4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.640563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:12.663683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1104/2165] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:12 2022] PUT /identity/v3/projects/7d092186420e4390aa6b6c95ea2abe08/users/a7e1952279d048e0b8aa47037b127627/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:12.669011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.669170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.669595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:12.678419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:12.680078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:12.698210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:12.699388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.706352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1062/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:12.782671 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1105/2167] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:12.800465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:12.801978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:12.824454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:12.917904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e18ef7-88db-481a-9ad4-e9c4be1ad12c service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:12.986111 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c82cb5-b2bb-4570-8683-eccb96c06f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:12.987057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82cb5-b2bb-4570-8683-eccb96c06f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:12.987350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82cb5-b2bb-4570-8683-eccb96c06f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:12.987625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82cb5-b2bb-4570-8683-eccb96c06f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.014933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:13.016813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:13.019561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82cb5-b2bb-4570-8683-eccb96c06f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.025168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c82cb5-b2bb-4570-8683-eccb96c06f9e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:13.037452 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd4cff-ed1b-4166-8648-2a0e4cb4f94a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:13.039966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1063/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:13.045763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:13.046904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.047450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.047940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] PATH_INFO: `/v3/projects/e0447d95bfa54a78b045183d62f9c578` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.053447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0447d95bfa54a78b045183d62f9c578)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.056706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:13.164738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0447d95bfa54a78b045183d62f9c578', 'request_id': 'req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:13.175326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0447d95bfa54a78b045183d62f9c578', 'request_id': 'req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:13.185646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0447d95bfa54a78b045183d62f9c578', 'request_id': 'req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:13.199138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] The token cache is being invalidate because project e0447d95bfa54a78b045183d62f9c578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:13.200470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:13.201178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bc3c30b9-aa88-430c-ad6c-3bb8eb5f6114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:13.207362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1106/2169] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:13 2022] DELETE /identity/v3/projects/e0447d95bfa54a78b045183d62f9c578 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:13.208449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.209050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.209244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.242488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:13.243866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:13.342792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1064/2170] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:13.351747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.352035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.352307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.428718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:13.435901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:13.477481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1107/2171] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:13.482168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:13.492082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91294-efa0-4c4d-9020-49975039c01e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:13.504055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:13.504936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.521549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.522024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.523370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:13.523370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.524828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:13.553190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:13.553979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1065/2172] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:41:13.562635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feeb56-18b5-4310-a6cc-f61cfc6fa461 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:13.567853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86cc8-3a83-42b7-b141-22d14336cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:13.568808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86cc8-3a83-42b7-b141-22d14336cff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.569112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86cc8-3a83-42b7-b141-22d14336cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.569359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86cc8-3a83-42b7-b141-22d14336cff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.575823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda86cc8-3a83-42b7-b141-22d14336cff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.577847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda86cc8-3a83-42b7-b141-22d14336cff1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:13.641050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1108/2173] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:13 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:13.645415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:13.655751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8af133-68b5-4841-8441-1fc4b42976cb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:13.721681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.722322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.722835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.790492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:13.800439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:13.801982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] MFA Rules not processed for user `880de431d70d4b35af04a043d7359661`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:13.802296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.802584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.802884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.804440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.808848 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:13.809014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:13.843463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1066/2174] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:13 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:13.847420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:13.860382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6671c-a28b-45b9-a9bd-e504f80ef1e0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:13.869413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:13.870299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.871001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.871387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.872502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.894595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:13.922299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1067/2175] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:13.923390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:13.938945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:13.946734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe867e-7247-40f7-9ab9-6710c5b6fde9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:13.969772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb043c-7439-46b0-8475-9b9dc7cb24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:13.970068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb043c-7439-46b0-8475-9b9dc7cb24b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:13.970293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb043c-7439-46b0-8475-9b9dc7cb24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:13.970583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb043c-7439-46b0-8475-9b9dc7cb24b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:13.971474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb043c-7439-46b0-8475-9b9dc7cb24b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:13.978840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1109/2176] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:13.980532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb043c-7439-46b0-8475-9b9dc7cb24b4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:14.009520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1068/2177] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:14.014153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:14.034721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3682-9cd7-42b6-8add-67ef9000070c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:14.043047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:14.043975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:14.044256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:14.044655 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] PATH_INFO: `/v3/projects/af8b9cd583554d6986a9a8de7494e23d/users/73f4d1577c004f16b966e7f9335cdb19/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:14.067891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8b9cd583554d6986a9a8de7494e23d, user_id=73f4d1577c004f16b966e7f9335cdb19, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:14.071525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:14.106404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a539e-64fe-47cd-9c23-e5b9ed3fe802 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:14.106671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a539e-64fe-47cd-9c23-e5b9ed3fe802 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:14.106963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a539e-64fe-47cd-9c23-e5b9ed3fe802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:14.108700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1110/2178] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:14 2022] PUT /identity/v3/projects/af8b9cd583554d6986a9a8de7494e23d/users/73f4d1577c004f16b966e7f9335cdb19/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:14.205801 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7d5a539e-64fe-47cd-9c23-e5b9ed3fe802 None None] MFA Rules not processed for user `73f4d1577c004f16b966e7f9335cdb19`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:14.207167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d5a539e-64fe-47cd-9c23-e5b9ed3fe802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:14.423515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1069/2179] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:14.428266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:14.479107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:14.479736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:14.480324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:14.559049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185aff2-4a3d-486d-91dc-971068acceb6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:14.570570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] MFA Rules not processed for user `a7e1952279d048e0b8aa47037b127627`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:14.573894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:14.574552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:14.574673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:14.574849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:14.575120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:14.575870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:14.577833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:14.652107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1111/2180] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:14 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:14.663513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:14.805427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09123136-4e68-46c5-bffe-9afb22ca000f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:14.812006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1070/2181] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:14.818858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:14.819897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:14.820345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:14.820859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:14.821849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:14.824113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:14.896519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1112/2182] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:14 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:14.902429 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:14.919720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4d86-f7a3-4464-bbd5-33d1591d6fa6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:14.942786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:14.943402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:14.943991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:14.944277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:14.945056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:14.946713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:14.993820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1071/2183] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:14.994461 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:15.009027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61b3cb-14e8-4f3a-bba8-8aff77447cd9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:15.017635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:15.018575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:15.019595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:15.019878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:15.020445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] PATH_INFO: `/v3/projects/d2e5d9096c644d8d8aa44dfe46204e8e/users/00a69263635a44e3b26ae851a71a6985/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:15.020794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:15.049891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e5d9096c644d8d8aa44dfe46204e8e, user_id=00a69263635a44e3b26ae851a71a6985, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:15.053278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:15.082009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:15.086208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1113/2184] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:14 2022] PUT /identity/v3/projects/d2e5d9096c644d8d8aa44dfe46204e8e/users/00a69263635a44e3b26ae851a71a6985/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:15.089922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:15.146841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383668d-bb5b-4d31-9217-44679757b014 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:15.153752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:15.232139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:15.259097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:15.259097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:15.259097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:15.259962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd595-93e1-4d5f-83b4-de4704f658b9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:15.296744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:15.301153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:15.301776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:15.302191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:15.303151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:15.305353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:15.328564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1114/2185] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:15.332896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:15.345166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfccd49-6996-4d8d-adb1-9e96e0b8246f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:15.358001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8992-a488-4539-90c1-01baa16cf7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:15.359045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8992-a488-4539-90c1-01baa16cf7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:15.359559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8992-a488-4539-90c1-01baa16cf7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:15.359799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8992-a488-4539-90c1-01baa16cf7af admin admin] PATH_INFO: `/v3/projects/d2e5d9096c644d8d8aa44dfe46204e8e/users/00a69263635a44e3b26ae851a71a6985/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:15.362288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8992-a488-4539-90c1-01baa16cf7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e5d9096c644d8d8aa44dfe46204e8e, user_id=00a69263635a44e3b26ae851a71a6985, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:15.365776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8992-a488-4539-90c1-01baa16cf7af admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:15.380599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1115/2186] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:15 2022] PUT /identity/v3/projects/d2e5d9096c644d8d8aa44dfe46204e8e/users/00a69263635a44e3b26ae851a71a6985/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:15.396643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:15.397176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:15.397565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:15.503097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] MFA Rules not processed for user `00a69263635a44e3b26ae851a71a6985`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:15.506837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:15.514430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:15.517819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:15.544442 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1072/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:15.769058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1116/2188] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:15.773602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:15.775188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:15.791618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38373f-79fb-499d-953f-3a9a033b485f service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:15.914922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d767cd-99ac-4132-9f1b-ccdd911ca492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:15.915634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d767cd-99ac-4132-9f1b-ccdd911ca492 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:15.915913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d767cd-99ac-4132-9f1b-ccdd911ca492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:15.916189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d767cd-99ac-4132-9f1b-ccdd911ca492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:15.942493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d767cd-99ac-4132-9f1b-ccdd911ca492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:15.944197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d767cd-99ac-4132-9f1b-ccdd911ca492 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:15.976611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1073/2189] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:15.999091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:16.185330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0226e7-70cb-4df2-ab23-03a8dfa331e2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:16.205229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:16.208422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:16.208422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:16.208422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] PATH_INFO: `/v3/users/73f4d1577c004f16b966e7f9335cdb19` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:16.213311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f4d1577c004f16b966e7f9335cdb19)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:16.213781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:16.310491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:16.345470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f4d1577c004f16b966e7f9335cdb19'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:16.375401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f4d1577c004f16b966e7f9335cdb19'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:16.376257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f4d1577c004f16b966e7f9335cdb19'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:16.396164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f4d1577c004f16b966e7f9335cdb19'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:16.440198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f4d1577c004f16b966e7f9335cdb19'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:16.455319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1117/2190] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:15 2022] DELETE /identity/v3/users/73f4d1577c004f16b966e7f9335cdb19 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:16.460283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:16.461324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:16.461850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:16.500103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:16.501597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:16.566631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:16.592657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1074/2191] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:16.610020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:16.611878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:16.794812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37440d-fd5f-4295-8d05-ade46e1e76bc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:16.802327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8efda6-2425-485a-92dd-6ceef0fade69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:16.803339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8efda6-2425-485a-92dd-6ceef0fade69 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:16.803620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8efda6-2425-485a-92dd-6ceef0fade69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:16.803891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8efda6-2425-485a-92dd-6ceef0fade69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:16.831815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8efda6-2425-485a-92dd-6ceef0fade69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:16.833631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8efda6-2425-485a-92dd-6ceef0fade69 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:16.846737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1118/2192] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:16.877533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:16.879774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:16.986224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3561b-b537-478e-8ecc-fad9a348ecf9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:16.992884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:16.994892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:16.995273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:16.995890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:16.999539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:17.101036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:17.102793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:17.128693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1075/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:17.313557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:17.314202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:17.314660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:17.351973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] MFA Rules not processed for user `a7e1952279d048e0b8aa47037b127627`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:17.355420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:17.485208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1119/2194] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:17.755766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:17.757292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:17.788215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30859ee-4824-43f1-aba5-4136b953b977 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:17.800511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:17.801417 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:17.801702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:17.801978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] PATH_INFO: `/v3/projects/af8b9cd583554d6986a9a8de7494e23d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:17.803226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8b9cd583554d6986a9a8de7494e23d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:17.805192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:17.908292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8b9cd583554d6986a9a8de7494e23d', 'request_id': 'req-55a6e42c-d0be-477c-8c94-e1a19375d883'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:17.927977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8b9cd583554d6986a9a8de7494e23d', 'request_id': 'req-55a6e42c-d0be-477c-8c94-e1a19375d883'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:17.938953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8b9cd583554d6986a9a8de7494e23d', 'request_id': 'req-55a6e42c-d0be-477c-8c94-e1a19375d883'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:17.954036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] The token cache is being invalidate because project af8b9cd583554d6986a9a8de7494e23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:17.954431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:17.955164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:17.957802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1076/2195] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:17 2022] DELETE /identity/v3/projects/af8b9cd583554d6986a9a8de7494e23d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:17.962136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:17.980521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763a76-df8c-4ca2-81e7-c789348ef6cb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:18.049803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:18.077614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:18.079505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:18.079945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:18.080362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] PATH_INFO: `/v3/users/00a69263635a44e3b26ae851a71a6985` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:18.082550 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a69263635a44e3b26ae851a71a6985)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:18.085152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:18.160446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a69263635a44e3b26ae851a71a6985'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.190330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a69263635a44e3b26ae851a71a6985'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.191655 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a69263635a44e3b26ae851a71a6985'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.210356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a69263635a44e3b26ae851a71a6985'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.224981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c56bc93f-3ca5-46a9-8eec-a7f2ae83918e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a69263635a44e3b26ae851a71a6985'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.235669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1120/2196] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:17 2022] DELETE /identity/v3/users/00a69263635a44e3b26ae851a71a6985 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:18.613499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:18.615210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:18.656455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6e42c-d0be-477c-8c94-e1a19375d883 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:18.678865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:18.743845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:18.744778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:18.745084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:18.745620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] PATH_INFO: `/v3/projects/d2e5d9096c644d8d8aa44dfe46204e8e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:18.747064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e5d9096c644d8d8aa44dfe46204e8e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:18.749814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:18.824198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e5d9096c644d8d8aa44dfe46204e8e', 'request_id': 'req-1148857c-f64b-48e8-a8b5-69b47fc27560'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.833790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e5d9096c644d8d8aa44dfe46204e8e', 'request_id': 'req-1148857c-f64b-48e8-a8b5-69b47fc27560'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.845160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e5d9096c644d8d8aa44dfe46204e8e', 'request_id': 'req-1148857c-f64b-48e8-a8b5-69b47fc27560'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.859432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] The token cache is being invalidate because project d2e5d9096c644d8d8aa44dfe46204e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:18.859885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.860866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1148857c-f64b-48e8-a8b5-69b47fc27560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:18.862867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1077/2197] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:18 2022] DELETE /identity/v3/projects/d2e5d9096c644d8d8aa44dfe46204e8e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:18.867739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:18.868257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:18.868566 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:18.889832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:18.892644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:18.966016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1121/2198] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:18.973923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:18.974219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:18.974503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:18.996558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:18.997793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:19.005773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1078/2199] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:19.010331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.024746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78a5a-ef1d-4336-b664-434ba3a2661b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.030943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.032065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.032065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.032385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.033454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:19.033928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.035839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.053398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1122/2200] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:41:19.057624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.068139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b81374-3987-4c15-ba5a-c010762305c1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.073256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.073907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.074191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.074522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.075171 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.077449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.106795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1079/2201] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:19 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:19.113020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.124414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b5eb1-e0f7-4c4b-81c0-eb3f790c4f5b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.217943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.220326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.220326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.220326 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.223365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.224293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.234193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:19.258319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.272143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1123/2202] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:19 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:19.284821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2304a-3036-418e-aa82-daad1ceed1e7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.290396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.291576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.291917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.292335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.293572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.295330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.310162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1080/2203] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:19.313940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.333479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae04f5f-a1aa-47e3-ab1a-04965cca3010 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.334980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6c6e-a929-457e-8092-772e726df561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.335806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6c6e-a929-457e-8092-772e726df561 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.336198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6c6e-a929-457e-8092-772e726df561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.336556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6c6e-a929-457e-8092-772e726df561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.337318 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6c6e-a929-457e-8092-772e726df561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.339000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6c6e-a929-457e-8092-772e726df561 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.359400 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1124/2204] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:19.360694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.371838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034cd6-db88-498f-bd65-031fbffc51c1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.378886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.379798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.380072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.380343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] PATH_INFO: `/v3/projects/074e74157e71498c8ba312c402617433/users/dbc8f98bdf5341e1b8bc6e5cd17ebeaa/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.396624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=074e74157e71498c8ba312c402617433, user_id=dbc8f98bdf5341e1b8bc6e5cd17ebeaa, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.399774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.419086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1081/2205] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:19 2022] PUT /identity/v3/projects/074e74157e71498c8ba312c402617433/users/dbc8f98bdf5341e1b8bc6e5cd17ebeaa/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:19.430598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.430862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.431140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.464675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] MFA Rules not processed for user `dbc8f98bdf5341e1b8bc6e5cd17ebeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:19.465899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:19.544013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1125/2206] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:19.548666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.604320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:19.619922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215370bc-c095-43ef-b1dd-b1325be0f226 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.624559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.625213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.625531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.625806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.626526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.628772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.660006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1082/2207] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:19 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:19.664775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.676019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457af1-9552-4c0b-a0b6-782234364f0e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.755637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.756330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.756667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.756943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.757639 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.759613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.788416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1126/2208] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:19 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:19.790016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.800536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37975-23c5-44d5-ba6f-ebc160da92aa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.805292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.805968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.806253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.806531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.807266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.808917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.820761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1083/2209] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:19.825061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.838643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185b174-79f4-4a12-97eb-b26441be597b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.843753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.844694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.844979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.845307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] PATH_INFO: `/v3/projects/91400d06d16c445ba8948c07611b423b/users/3ca2509301414931a2318651729c5582/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.861229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91400d06d16c445ba8948c07611b423b, user_id=3ca2509301414931a2318651729c5582, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.863948 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.878703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1127/2210] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:19 2022] PUT /identity/v3/projects/91400d06d16c445ba8948c07611b423b/users/3ca2509301414931a2318651729c5582/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:19.882865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:19.893583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb951-b503-46b2-80e5-b2b4c99d010a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:19.970690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d46c4-7b6c-442e-b238-e13bddb931c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:19.971546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d46c4-7b6c-442e-b238-e13bddb931c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:19.972051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d46c4-7b6c-442e-b238-e13bddb931c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:19.972758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d46c4-7b6c-442e-b238-e13bddb931c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:19.973612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d46c4-7b6c-442e-b238-e13bddb931c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:19.975404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d46c4-7b6c-442e-b238-e13bddb931c7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:19.988522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1084/2211] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:19.990325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:20.000884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a04fe-6079-4475-8eed-836cb7533354 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:20.006207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:20.007266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:20.007652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:20.007937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] PATH_INFO: `/v3/projects/91400d06d16c445ba8948c07611b423b/users/3ca2509301414931a2318651729c5582/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:20.013523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91400d06d16c445ba8948c07611b423b, user_id=3ca2509301414931a2318651729c5582, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:20.016760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:20.039469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1128/2212] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:19 2022] PUT /identity/v3/projects/91400d06d16c445ba8948c07611b423b/users/3ca2509301414931a2318651729c5582/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:20.040734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:20.041028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:20.041307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:20.071602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] MFA Rules not processed for user `3ca2509301414931a2318651729c5582`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:20.072901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:20.169094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1085/2213] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:20.182942 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:20.185894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:20.223856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:20.267968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de24e0-30fc-45c0-9074-f208d0ee6eb5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:20.272179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:20.272891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:20.273175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:20.273842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:20.285991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:20.290292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:20.304103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1129/2214] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:20.427657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:20.442266 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d63065-f121-4228-a2b3-ec0c7813e955 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:20.446654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6326dea-eb66-4457-8dae-58667b30bf62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:20.447219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326dea-eb66-4457-8dae-58667b30bf62 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:20.447549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326dea-eb66-4457-8dae-58667b30bf62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:20.447765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6326dea-eb66-4457-8dae-58667b30bf62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:20.497098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:20.527756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6326dea-eb66-4457-8dae-58667b30bf62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:20.529265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6326dea-eb66-4457-8dae-58667b30bf62 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:20.552767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1086/2215] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:25.561924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:25.629532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ee58-f197-436a-b3ce-f27d3d2df6fb service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:25.634931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:25.635883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:25.636163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:25.636435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] PATH_INFO: `/v3/users/dbc8f98bdf5341e1b8bc6e5cd17ebeaa` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:25.637768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc8f98bdf5341e1b8bc6e5cd17ebeaa)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:25.639766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:25.696269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc8f98bdf5341e1b8bc6e5cd17ebeaa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:25.712756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc8f98bdf5341e1b8bc6e5cd17ebeaa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:25.713701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc8f98bdf5341e1b8bc6e5cd17ebeaa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:25.722634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc8f98bdf5341e1b8bc6e5cd17ebeaa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:25.732611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc8f98bdf5341e1b8bc6e5cd17ebeaa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:25.739312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1130/2216] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:25 2022] DELETE /identity/v3/users/dbc8f98bdf5341e1b8bc6e5cd17ebeaa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:25.743830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:25.744263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:25.744619 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:25.762643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:25.763866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:25.836312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1087/2217] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:25.846288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:25.848370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:25.940062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:25.947000 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3530e-57c6-4562-bff3-142a5c4af065 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:25.952356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:25.953043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:25.953328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:25.953604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:25.964049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:25.965560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:25.975867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1131/2218] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:26.309894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:26.311457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:26.334455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8ad1-9ac7-426e-b124-f0f00d53e812 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:26.365333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:26.376597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:26.376976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:26.377153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] PATH_INFO: `/v3/projects/074e74157e71498c8ba312c402617433` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:26.378611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=074e74157e71498c8ba312c402617433)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:26.380752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:26.451750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074e74157e71498c8ba312c402617433', 'request_id': 'req-5437ea0e-52d9-4ac1-9632-b812473788a7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.459863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074e74157e71498c8ba312c402617433', 'request_id': 'req-5437ea0e-52d9-4ac1-9632-b812473788a7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.466501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074e74157e71498c8ba312c402617433', 'request_id': 'req-5437ea0e-52d9-4ac1-9632-b812473788a7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.482528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] The token cache is being invalidate because project 074e74157e71498c8ba312c402617433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:26.482708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.483307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.484909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1088/2219] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:26 2022] DELETE /identity/v3/projects/074e74157e71498c8ba312c402617433 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:26.489044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:26.498719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f073-3d28-4be7-8a25-a372e39bd6de service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:26.561084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:26.562039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:26.562683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:26.562683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] PATH_INFO: `/v3/users/3ca2509301414931a2318651729c5582` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:26.563816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca2509301414931a2318651729c5582)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:26.565947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:26.616607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca2509301414931a2318651729c5582'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.630518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca2509301414931a2318651729c5582'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.631689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca2509301414931a2318651729c5582'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.640115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca2509301414931a2318651729c5582'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.648433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b9678a6d-fd10-4746-9318-392b5daa79e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca2509301414931a2318651729c5582'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:26.654715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1132/2220] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:26 2022] DELETE /identity/v3/users/3ca2509301414931a2318651729c5582 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:26.975278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:26.978146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:27.002878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437ea0e-52d9-4ac1-9632-b812473788a7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.065613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.066585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.066948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.067269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] PATH_INFO: `/v3/projects/91400d06d16c445ba8948c07611b423b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.068570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91400d06d16c445ba8948c07611b423b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.070563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.078006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:27.135893 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91400d06d16c445ba8948c07611b423b', 'request_id': 'req-6595bec5-ef76-4913-bf88-3e1d8325d347'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:27.145217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91400d06d16c445ba8948c07611b423b', 'request_id': 'req-6595bec5-ef76-4913-bf88-3e1d8325d347'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:27.151873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91400d06d16c445ba8948c07611b423b', 'request_id': 'req-6595bec5-ef76-4913-bf88-3e1d8325d347'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:27.166611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] The token cache is being invalidate because project 91400d06d16c445ba8948c07611b423b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:27.166905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:27.167550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6595bec5-ef76-4913-bf88-3e1d8325d347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:27.169302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1089/2221] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:26 2022] DELETE /identity/v3/projects/91400d06d16c445ba8948c07611b423b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:27.174402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.175169 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.175448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.195087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:27.196284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:27.256534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1133/2222] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:27.264659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.264985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.265281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.286672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:27.287890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:27.297994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1090/2223] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:27.302405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.312309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71f0c0-10a7-4829-ae16-448963f1f5e0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.317545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.318263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.318572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.318839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.319564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:27.319866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.321479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.324542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:27.338937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1134/2224] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:41:27.343178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.353075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0335ae1-9fc5-42ab-bc98-31a89092d873 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.359159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.359912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.360287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.360754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.361587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.363645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.392360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1091/2225] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:27.396514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.415759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4e342-14c1-4fbe-91d2-fdc5fa93956c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.479307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.479989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.480516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.480795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.481876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.483673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.509766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1135/2226] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:27.513777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.526290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc83eff-21d7-4b5e-bb27-36a43cf47aaa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.534241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.534682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.535186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.535406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.536559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.538178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.554726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1092/2227] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:27.556007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.571322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e400fd9-450d-470f-855a-e8bd4f1c282a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.577311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c0145-8ff4-4f0f-805e-cd47d29d4d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.578095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c0145-8ff4-4f0f-805e-cd47d29d4d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.578419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c0145-8ff4-4f0f-805e-cd47d29d4d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.578756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c0145-8ff4-4f0f-805e-cd47d29d4d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.579636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c0145-8ff4-4f0f-805e-cd47d29d4d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.581436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c0145-8ff4-4f0f-805e-cd47d29d4d26 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.592402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1136/2228] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:41:27.598451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.609580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320ade-0bba-43c5-8a1a-4583f95b446a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.614377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.615466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.615738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.616072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] PATH_INFO: `/v3/projects/9f0be5f28f7b4ac489d5dbc1c071deda/users/f6ebfd44c460491f95cf606ac0331be9/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.633017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0be5f28f7b4ac489d5dbc1c071deda, user_id=f6ebfd44c460491f95cf606ac0331be9, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.635662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.652084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1093/2229] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:27 2022] PUT /identity/v3/projects/9f0be5f28f7b4ac489d5dbc1c071deda/users/f6ebfd44c460491f95cf606ac0331be9/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:27.663828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.664871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.665286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.697628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] MFA Rules not processed for user `f6ebfd44c460491f95cf606ac0331be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:27.698882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:27.776120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1137/2230] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:27.780692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.854860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da861b-925e-4a3f-b5f9-aa8934a8cb4a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.859554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.860291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.860691 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.861034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.861805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.863816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.893712 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1094/2231] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:27.895041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:27.905892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7323399-9451-4e2e-8897-8ac527e570fa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:27.963272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:27.963937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:27.964352 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:27.964656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:27.965351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:27.967392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:27.977040 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:28.000164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1138/2232] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:27 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:28.003655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:28.014657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3b02-c1f8-4ff0-a6dd-9c7bb39f4960 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:28.019547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:28.020433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.020807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.021231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.022170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:28.023772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:28.035404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1095/2233] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:28.040127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:28.050753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08374ddf-30a3-4506-b5e4-5b9235785afd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:28.057143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:28.058084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.058364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.058635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] PATH_INFO: `/v3/projects/447159ec03064a1ca8af10fd62dead54/users/608bfdfe74ad4e528a7eed7453f22d30/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.080410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=447159ec03064a1ca8af10fd62dead54, user_id=608bfdfe74ad4e528a7eed7453f22d30, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:28.083327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:28.098794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1139/2234] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:28 2022] PUT /identity/v3/projects/447159ec03064a1ca8af10fd62dead54/users/608bfdfe74ad4e528a7eed7453f22d30/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:28.103563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:28.110333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:28.114406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75dbcf-5a09-49c3-9724-6ad405b19fbf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:28.174021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7842b-10e5-4443-88b7-cc35959cce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:28.174723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7842b-10e5-4443-88b7-cc35959cce9f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.175048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7842b-10e5-4443-88b7-cc35959cce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.175340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7842b-10e5-4443-88b7-cc35959cce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.176075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7842b-10e5-4443-88b7-cc35959cce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:28.178207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7842b-10e5-4443-88b7-cc35959cce9f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:28.188869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1096/2235] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:28.193384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:28.204171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28b25a-448c-4280-a7db-933b7abcfc5d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:28.209438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:28.210334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.210615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.210889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] PATH_INFO: `/v3/projects/447159ec03064a1ca8af10fd62dead54/users/608bfdfe74ad4e528a7eed7453f22d30/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.212988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447159ec03064a1ca8af10fd62dead54, user_id=608bfdfe74ad4e528a7eed7453f22d30, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:28.215650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:28.226667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1140/2236] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:28 2022] PUT /identity/v3/projects/447159ec03064a1ca8af10fd62dead54/users/608bfdfe74ad4e528a7eed7453f22d30/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:28.238106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.238395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.238668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.265902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] MFA Rules not processed for user `608bfdfe74ad4e528a7eed7453f22d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:28.267405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:28.340092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1097/2237] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:28.352414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:28.354533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:28.417036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ab49c-29b2-4aa9-acdd-e7d411eec174 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:28.421215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:28.421873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.422159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.422500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.432404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:28.434018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:28.447491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1141/2238] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:28.519954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:28.530169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d53f-8e40-4ef7-adcf-dddd006627ab None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:28.535350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce0d06-d1f4-474f-a743-2c8cf1931b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:28.536364 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0d06-d1f4-474f-a743-2c8cf1931b0e service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:28.536671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0d06-d1f4-474f-a743-2c8cf1931b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:28.536929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0d06-d1f4-474f-a743-2c8cf1931b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:28.598554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce0d06-d1f4-474f-a743-2c8cf1931b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:28.600048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce0d06-d1f4-474f-a743-2c8cf1931b0e service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:28.610839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1098/2239] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:28.946881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:29.014327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f003ba1-65e2-4bef-8d75-1fee4fa12ea7 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:29.019201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:29.020096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:29.020373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:29.020675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] PATH_INFO: `/v3/users/f6ebfd44c460491f95cf606ac0331be9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:29.021957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ebfd44c460491f95cf606ac0331be9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:29.024154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:29.097473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ebfd44c460491f95cf606ac0331be9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:29.109003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:29.111725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ebfd44c460491f95cf606ac0331be9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:29.112761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ebfd44c460491f95cf606ac0331be9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:29.128625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ebfd44c460491f95cf606ac0331be9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:29.137641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ebfd44c460491f95cf606ac0331be9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:29.144845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1142/2240] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:28 2022] DELETE /identity/v3/users/f6ebfd44c460491f95cf606ac0331be9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:29.149625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:29.150106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:29.150194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:29.176416 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:29.177779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:29.205577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:29.248162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1099/2241] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:29.266935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:29.268450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:29.333895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7650b7-a3e0-46fc-a833-be7e44c0254b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:29.338164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:29.339154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:29.339405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:29.339654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:29.353384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:29.354978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:29.365911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1143/2242] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:41:30.050122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:30.051469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:30.078343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ebcc9-d57e-4a23-9d88-d2a64c170ed4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:30.084109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:30.085161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:30.085567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:30.086011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] PATH_INFO: `/v3/projects/9f0be5f28f7b4ac489d5dbc1c071deda` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:30.087560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0be5f28f7b4ac489d5dbc1c071deda)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:30.090231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:30.180393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0be5f28f7b4ac489d5dbc1c071deda', 'request_id': 'req-134235d2-ba7a-4544-a7e9-568a94f917b0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.201758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0be5f28f7b4ac489d5dbc1c071deda', 'request_id': 'req-134235d2-ba7a-4544-a7e9-568a94f917b0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.214000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0be5f28f7b4ac489d5dbc1c071deda', 'request_id': 'req-134235d2-ba7a-4544-a7e9-568a94f917b0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.229601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] The token cache is being invalidate because project 9f0be5f28f7b4ac489d5dbc1c071deda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:30.230920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.232250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.238272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1100/2243] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:30 2022] DELETE /identity/v3/projects/9f0be5f28f7b4ac489d5dbc1c071deda => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:30.242039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:30.252687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdd76-018d-463b-bc8c-c6281480c9d8 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:30.356977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:30.358120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:30.358630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:30.359076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] PATH_INFO: `/v3/users/608bfdfe74ad4e528a7eed7453f22d30` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:30.361437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] RBAC: Authorizing `identity:delete_user(user_id=608bfdfe74ad4e528a7eed7453f22d30)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:30.365336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:30.476624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608bfdfe74ad4e528a7eed7453f22d30'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.517405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608bfdfe74ad4e528a7eed7453f22d30'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.518171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608bfdfe74ad4e528a7eed7453f22d30'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.527931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608bfdfe74ad4e528a7eed7453f22d30'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.541322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-851eec8c-27c4-4544-98c6-2c043f95fdef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608bfdfe74ad4e528a7eed7453f22d30'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:30.545478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:30.553080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1144/2244] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:30 2022] DELETE /identity/v3/users/608bfdfe74ad4e528a7eed7453f22d30 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:30.859733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:30.861354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:30.875790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134235d2-ba7a-4544-a7e9-568a94f917b0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:30.947298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:30.948243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:30.948553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:30.948834 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] PATH_INFO: `/v3/projects/447159ec03064a1ca8af10fd62dead54` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:30.950059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=447159ec03064a1ca8af10fd62dead54)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:30.951974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:31.023503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447159ec03064a1ca8af10fd62dead54', 'request_id': 'req-4c25c873-ebe8-420b-8b38-97740622cd5a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:31.030027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:31.054134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447159ec03064a1ca8af10fd62dead54', 'request_id': 'req-4c25c873-ebe8-420b-8b38-97740622cd5a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:31.061467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447159ec03064a1ca8af10fd62dead54', 'request_id': 'req-4c25c873-ebe8-420b-8b38-97740622cd5a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:31.081772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] The token cache is being invalidate because project 447159ec03064a1ca8af10fd62dead54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:31.082068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:31.082909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:31.085231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1101/2245] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:30 2022] DELETE /identity/v3/projects/447159ec03064a1ca8af10fd62dead54 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:35.497990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf26b00-0a01-4ff3-adba-86e97144abb5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:35.498555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf26b00-0a01-4ff3-adba-86e97144abb5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:35.498691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf26b00-0a01-4ff3-adba-86e97144abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:35.518163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0bf26b00-0a01-4ff3-adba-86e97144abb5 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:35.519379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0bf26b00-0a01-4ff3-adba-86e97144abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:35.592303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1145/2246] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:35.609679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:35.611189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:35.688447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c873-ebe8-420b-8b38-97740622cd5a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:35.693972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd59c67-228a-4981-a21c-10212e88e927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:35.694628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd59c67-228a-4981-a21c-10212e88e927 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:35.694951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd59c67-228a-4981-a21c-10212e88e927 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:35.695211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd59c67-228a-4981-a21c-10212e88e927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:35.703457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd59c67-228a-4981-a21c-10212e88e927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:35.705071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd59c67-228a-4981-a21c-10212e88e927 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:35.714968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1102/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:37.744650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c429-b42c-4b7a-99a1-4e31045a350c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:37.745256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c429-b42c-4b7a-99a1-4e31045a350c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:37.746350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c429-b42c-4b7a-99a1-4e31045a350c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:37.748679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1146/2248] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:41:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:41:37.761688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:37.762254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:37.762254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:37.792296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] MFA Rules not processed for user `2181bb81957a46e6ae1fccf0b32e66fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:37.793960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:37.897596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1103/2249] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:41:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:37.908878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c429-b42c-4b7a-99a1-4e31045a350c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:37.911399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4fd3c429-b42c-4b7a-99a1-4e31045a350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:37.931411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c429-b42c-4b7a-99a1-4e31045a350c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:37.940068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:37.940759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:37.941262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:37.941576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:37.950561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:37.952165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:37.963495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1147/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:38.511708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:38.514262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:38.553603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504d66c-598a-4ff7-a6f0-47aabcaff74e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:38.561739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:38.563326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:38.563775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:38.564509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] PATH_INFO: `/v3/users/d1d75e6b70ec4f7c9b56d9274df390e7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:38.566541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d75e6b70ec4f7c9b56d9274df390e7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:38.569667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:38.618445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d75e6b70ec4f7c9b56d9274df390e7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.626793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d75e6b70ec4f7c9b56d9274df390e7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.627430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d75e6b70ec4f7c9b56d9274df390e7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.628896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:38.636346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d75e6b70ec4f7c9b56d9274df390e7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.637208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d75e6b70ec4f7c9b56d9274df390e7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.654634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1104/2251] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:38 2022] DELETE /identity/v3/users/d1d75e6b70ec4f7c9b56d9274df390e7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:38.833131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:38.843813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb976e7e-2434-4495-bd51-9e9092d399b3 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:38.908008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:38.908993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:38.909272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:38.909542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] PATH_INFO: `/v3/projects/7319d9d4586d496bb45a40f47d9fc409` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:38.911229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7319d9d4586d496bb45a40f47d9fc409)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:38.913311 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:38.965930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7319d9d4586d496bb45a40f47d9fc409', 'request_id': 'req-0ce50c16-41bb-47e7-a80a-9142a050292a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.971697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7319d9d4586d496bb45a40f47d9fc409', 'request_id': 'req-0ce50c16-41bb-47e7-a80a-9142a050292a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.978940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7319d9d4586d496bb45a40f47d9fc409', 'request_id': 'req-0ce50c16-41bb-47e7-a80a-9142a050292a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.990959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] The token cache is being invalidate because project 7319d9d4586d496bb45a40f47d9fc409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:38.991247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.991864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0ce50c16-41bb-47e7-a80a-9142a050292a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:38.993454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1148/2252] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:38 2022] DELETE /identity/v3/projects/7319d9d4586d496bb45a40f47d9fc409 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:38.997509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:38.999044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.012128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771a791-24bb-4875-b4f7-36d5ce659275 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:39.077466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:39.078359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.078643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.078915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] PATH_INFO: `/v3/users/0ccf2e9ecac44b21b6858651090228a3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.080152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccf2e9ecac44b21b6858651090228a3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:39.082172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:39.132664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccf2e9ecac44b21b6858651090228a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.143293 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccf2e9ecac44b21b6858651090228a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.143933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccf2e9ecac44b21b6858651090228a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.153239 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccf2e9ecac44b21b6858651090228a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.153813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccf2e9ecac44b21b6858651090228a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.172633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1105/2253] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:38 2022] DELETE /identity/v3/users/0ccf2e9ecac44b21b6858651090228a3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:39.395171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.395680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.396107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.424911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:39.426250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.443610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:39.446825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.480691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:39.539774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:39.559894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31fda-4f4b-4ca8-828c-3be28d349661 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:39.568272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:39.570211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.570636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.571011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] PATH_INFO: `/v3/projects/77bf17b71ef543cb8b6558023abb63ff` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.574002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bf17b71ef543cb8b6558023abb63ff)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:39.577804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:39.578723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1149/2254] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:39.602357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:39.603853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.650367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bf17b71ef543cb8b6558023abb63ff', 'request_id': 'req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.663963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bf17b71ef543cb8b6558023abb63ff', 'request_id': 'req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.671338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bf17b71ef543cb8b6558023abb63ff', 'request_id': 'req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.684847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] The token cache is being invalidate because project 77bf17b71ef543cb8b6558023abb63ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:39.685202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.686000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d74ccea9-ba2f-4d45-b0d9-ff4ff601f9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:39.688786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1106/2255] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:39 2022] DELETE /identity/v3/projects/77bf17b71ef543cb8b6558023abb63ff => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:39.697956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17e882-ea98-4a2c-a587-87a29cf730b7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.698305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17e882-ea98-4a2c-a587-87a29cf730b7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.698632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17e882-ea98-4a2c-a587-87a29cf730b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.709574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f817adf-3793-4b88-81c7-dac5441e81f2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:39.724773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dc17e882-ea98-4a2c-a587-87a29cf730b7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:39.732058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dc17e882-ea98-4a2c-a587-87a29cf730b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.800546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:39.801261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.801546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.801820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.804064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.811864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1107/2256] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:39.819151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:39.821035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:39.821254 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.821655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.822141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.833672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1150/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:39.855231 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:39.860903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:39.874016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1108/2258] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:39.879140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:39.891474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ae80e-30c7-4afe-905c-b8634afe0dc2 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:39.897416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:39.898210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.898495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.898773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.899515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:39.900346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:39.901681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:39.917426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1151/2259] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:41:39.921838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:39.931157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf57e2-b43a-4558-98cd-f10d4ed20573 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:39.935805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:39.936541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:39.936825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:39.937100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:39.937806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:39.939723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:39.966094 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1109/2260] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:39 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:39.970443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:39.987333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1f87-e93f-4491-8829-22c93e0eca50 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.015449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:40.069928 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.071839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.072231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.072667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.073748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.076221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.101180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1152/2261] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:39 2022] POST /identity/v3/users => generated 280 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:40.106888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:40.117329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea5503-52f9-47c0-b2d4-52858e297a17 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.122062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.122736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.123020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.123296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.124024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.125686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.136648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1110/2262] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:40.140769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:40.151339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aefd43-7d29-41a7-bb00-81def1338424 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.156392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec69f5-3211-4385-b1bc-59c8ab1fce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.157068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec69f5-3211-4385-b1bc-59c8ab1fce6e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.157350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec69f5-3211-4385-b1bc-59c8ab1fce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.157625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec69f5-3211-4385-b1bc-59c8ab1fce6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.158387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec69f5-3211-4385-b1bc-59c8ab1fce6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.160112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec69f5-3211-4385-b1bc-59c8ab1fce6e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.171231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1153/2263] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:40.175437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:40.185392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1a2b-1672-4421-917a-78886bdd16f0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.190023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.190913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.191310 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.191590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] PATH_INFO: `/v3/projects/a3a84c705ecd4076b237604d211050cc/users/8f595e449218427b9c6442bda4948247/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.206201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a84c705ecd4076b237604d211050cc, user_id=8f595e449218427b9c6442bda4948247, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.208990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.223010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1111/2264] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:40 2022] PUT /identity/v3/projects/a3a84c705ecd4076b237604d211050cc/users/8f595e449218427b9c6442bda4948247/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:40.233323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.233614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.233888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.262080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] MFA Rules not processed for user `8f595e449218427b9c6442bda4948247`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:40.263460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:40.333012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1154/2265] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:40.363438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:40.365389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:40.386940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:40.426959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f99a-c16f-497b-9ccb-c0e8fa1cd44c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.431118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a009eb-b3d0-4ab1-a332-00ff935bb524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.431778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a009eb-b3d0-4ab1-a332-00ff935bb524 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.432055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a009eb-b3d0-4ab1-a332-00ff935bb524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.432324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a009eb-b3d0-4ab1-a332-00ff935bb524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.441596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a009eb-b3d0-4ab1-a332-00ff935bb524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.443041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a009eb-b3d0-4ab1-a332-00ff935bb524 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.452117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1112/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:40 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:40.466048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:40.529982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a6782-38b0-493a-b5ba-48ddffe17202 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.535061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.536248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.536564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.536843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] PATH_INFO: `/v3/users/8f595e449218427b9c6442bda4948247` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.538091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f595e449218427b9c6442bda4948247)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.540025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.581553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:40.588004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f595e449218427b9c6442bda4948247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:40.600941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f595e449218427b9c6442bda4948247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:40.602884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f595e449218427b9c6442bda4948247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:40.617943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f595e449218427b9c6442bda4948247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:40.634421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f595e449218427b9c6442bda4948247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:40.648557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1155/2267] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:40 2022] DELETE /identity/v3/users/8f595e449218427b9c6442bda4948247 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:40.649441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.649731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.650020 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.672690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:40.674789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:40.745565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1113/2268] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:40.754007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:40.755689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:40.812980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3d33-c6b6-4bb0-98b1-4584d843a14d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:40.817091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07fb99-8db2-41da-b2ac-7af61642c834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:40.818028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fb99-8db2-41da-b2ac-7af61642c834 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:40.818309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fb99-8db2-41da-b2ac-7af61642c834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:40.818576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07fb99-8db2-41da-b2ac-7af61642c834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:40.827726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fb99-8db2-41da-b2ac-7af61642c834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:40.829280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07fb99-8db2-41da-b2ac-7af61642c834 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:40.838827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1156/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:41.126782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.128431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:41.142398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5770327-5260-4b20-8f46-0fdcde639e3e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.147899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.148827 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.149097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.149365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] PATH_INFO: `/v3/projects/a3a84c705ecd4076b237604d211050cc` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.150569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a84c705ecd4076b237604d211050cc)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.152499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.211194 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a84c705ecd4076b237604d211050cc', 'request_id': 'req-69e47046-cbca-4d00-89b8-ca4827990a98'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.220509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a84c705ecd4076b237604d211050cc', 'request_id': 'req-69e47046-cbca-4d00-89b8-ca4827990a98'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.227614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a84c705ecd4076b237604d211050cc', 'request_id': 'req-69e47046-cbca-4d00-89b8-ca4827990a98'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.240136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] The token cache is being invalidate because project a3a84c705ecd4076b237604d211050cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:41.240744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.242273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-69e47046-cbca-4d00-89b8-ca4827990a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.244635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1114/2270] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:41 2022] DELETE /identity/v3/projects/a3a84c705ecd4076b237604d211050cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:41.249368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.249655 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.249926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.268192 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:41.269570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:41.346287 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1157/2271] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:41.354062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.354349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.354626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.373216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:41.374405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:41.382521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1115/2272] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:41.387010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.397157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db804-a4af-46fb-9dde-b89fb34a194f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.401794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.402446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.402726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.402999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.403728 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:41.404036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.405756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.418331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1158/2273] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:41:41.423374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.433044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779c898-6aed-4675-9ea9-b46712ddbe99 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.439177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.439913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.440267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.440637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.441437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.443468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.476444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1116/2274] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:41.480555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.492511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d41c7-d63a-4281-b217-efa4b9396642 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.538768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:41.554084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.554761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.555293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.555293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.556074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.558049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.582048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1159/2275] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:41.583342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.593943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edc71-377e-4dd1-89e0-b260532dcb1a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.598718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.600174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.600583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.600853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.601647 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.603357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.614546 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1117/2276] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:41.620863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.630829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a993e9-0b52-46f8-ad45-255035b865af admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.636286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5a98e-dd0d-498d-a0be-b728a4ef19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.637166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a98e-dd0d-498d-a0be-b728a4ef19d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.637479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a98e-dd0d-498d-a0be-b728a4ef19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.637805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a98e-dd0d-498d-a0be-b728a4ef19d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.638526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a98e-dd0d-498d-a0be-b728a4ef19d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.640493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a98e-dd0d-498d-a0be-b728a4ef19d5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.650592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1160/2277] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:41.655248 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.663465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:41.667511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6af46-4bb4-41b4-a8ac-f9cccf0bed4b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.675074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.676236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.676717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.677051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] PATH_INFO: `/v3/projects/d2de2932bef04f04935e84862fa65c1e/users/358664fa71be4ef4aa9324719de9aad0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.695711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de2932bef04f04935e84862fa65c1e, user_id=358664fa71be4ef4aa9324719de9aad0, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.698453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.720549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1118/2278] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:41 2022] PUT /identity/v3/projects/d2de2932bef04f04935e84862fa65c1e/users/358664fa71be4ef4aa9324719de9aad0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:41.727763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.728049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.728325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.767020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] MFA Rules not processed for user `358664fa71be4ef4aa9324719de9aad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:41.768234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:41.800919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.802999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:41.873327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1161/2279] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:41.877358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.894389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300cae-2455-4ffb-ad0a-e9bd80254032 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.900106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.900265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f39b-f804-4a7b-ae46-02e8dc06049a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:41.901042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.901327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.901737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] PATH_INFO: `/v3/users/d3811885787f440ebbaeb2acc54b337a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.902964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3811885787f440ebbaeb2acc54b337a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.904943 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.908786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:41.909662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:41.910007 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:41.910621 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:41.911415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:41.913249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:41.941870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1162/2280] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:41.945602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:41.975322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3811885787f440ebbaeb2acc54b337a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.985928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3811885787f440ebbaeb2acc54b337a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:41.987885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3811885787f440ebbaeb2acc54b337a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.000324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3811885787f440ebbaeb2acc54b337a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.002028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6e354915-ba3a-4f3e-9bf1-a907e568d120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3811885787f440ebbaeb2acc54b337a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.018803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13f131-3b4e-4b97-bcb5-11f23c86c456 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.025612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.026299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.026580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.026853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.027547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.030725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1119/2281] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:41 2022] DELETE /identity/v3/users/d3811885787f440ebbaeb2acc54b337a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:42.030890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.032426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.032894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.033180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.059323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1163/2282] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:41 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:42.059535 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:42.060390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.060704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.062044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.074041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577a781-194d-469b-874b-2873dd279b3a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.100399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:42.119582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:42.129186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1120/2283] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:42.138498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.139826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.140859 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.141539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.141819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.142092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.142815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.144506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.154425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1164/2284] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:42.158511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.168183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529c23-1c9a-48a4-9e94-c4cf995d802a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.172774 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.173751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.173919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.174191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] PATH_INFO: `/v3/projects/16ced9861aa74a84abb3b03311d0258c/users/ce2b1bb4c8224c11986890ec2beab270/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.188934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ced9861aa74a84abb3b03311d0258c, user_id=ce2b1bb4c8224c11986890ec2beab270, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.191618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.195594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac7cf-64c4-4ce6-a536-79ee23726b93 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.199532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.200257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.200640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.200917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.205606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1165/2285] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:42 2022] PUT /identity/v3/projects/16ced9861aa74a84abb3b03311d0258c/users/ce2b1bb4c8224c11986890ec2beab270/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:42.209438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.212202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.213758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.223635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1121/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:41:42.271486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4bb5-7dae-4afe-82a2-bf6cf2679aaf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.277601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beede41-42c0-4dfd-9265-326817e6c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.278342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beede41-42c0-4dfd-9265-326817e6c5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.278741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beede41-42c0-4dfd-9265-326817e6c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.280373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beede41-42c0-4dfd-9265-326817e6c5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.280373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beede41-42c0-4dfd-9265-326817e6c5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.282130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beede41-42c0-4dfd-9265-326817e6c5a7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.296513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1166/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:42.299547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.311618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab4b8f-d18b-4f9b-a1ce-c5585cdc5bec service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.319790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.321135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.321489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.321817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] PATH_INFO: `/v3/projects/16ced9861aa74a84abb3b03311d0258c/users/ce2b1bb4c8224c11986890ec2beab270/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.324004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ced9861aa74a84abb3b03311d0258c, user_id=ce2b1bb4c8224c11986890ec2beab270, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.327313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.340907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1122/2288] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:42 2022] PUT /identity/v3/projects/16ced9861aa74a84abb3b03311d0258c/users/ce2b1bb4c8224c11986890ec2beab270/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:42.351532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.351899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.352079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.397070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] MFA Rules not processed for user `ce2b1bb4c8224c11986890ec2beab270`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:42.399423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.482126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1167/2289] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:42.493337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.495024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.554545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d29da-1fb3-4c98-ba8e-bffdd61ce1ea admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.558652 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.559314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.559599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.559866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.561693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.626461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.627932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.637725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1123/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:42.649805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:42.651190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:42.676260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:42.728320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b7a5-b9c3-437d-9590-068680adcea5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:42.733336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:42.734211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:42.734492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:42.734768 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] PATH_INFO: `/v3/projects/cbb341cc293742cf956fed850e766cd4` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:42.735954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb341cc293742cf956fed850e766cd4)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:42.738049 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:42.790478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb341cc293742cf956fed850e766cd4', 'request_id': 'req-fa7ab903-e574-4f47-a8d9-819021641903'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.799280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb341cc293742cf956fed850e766cd4', 'request_id': 'req-fa7ab903-e574-4f47-a8d9-819021641903'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.810156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb341cc293742cf956fed850e766cd4', 'request_id': 'req-fa7ab903-e574-4f47-a8d9-819021641903'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.822825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] The token cache is being invalidate because project cbb341cc293742cf956fed850e766cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:42.823128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.823836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fa7ab903-e574-4f47-a8d9-819021641903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:42.825546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1168/2291] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:42 2022] DELETE /identity/v3/projects/cbb341cc293742cf956fed850e766cd4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:45.221269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:45.234391 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5785-0ad8-49a6-8d16-c1725b7331cf service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:45.292976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:45.322786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:45.323684 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:45.323965 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:45.324402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] PATH_INFO: `/v3/users/358664fa71be4ef4aa9324719de9aad0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:45.325641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358664fa71be4ef4aa9324719de9aad0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:45.327559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:45.389483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358664fa71be4ef4aa9324719de9aad0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:45.397821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358664fa71be4ef4aa9324719de9aad0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:45.399307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358664fa71be4ef4aa9324719de9aad0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:45.410936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358664fa71be4ef4aa9324719de9aad0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:45.411873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358664fa71be4ef4aa9324719de9aad0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:45.447208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1124/2292] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:45 2022] DELETE /identity/v3/users/358664fa71be4ef4aa9324719de9aad0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:45.453059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6eda6-c7ac-417e-ad57-e5d954c74092 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:45.453524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6eda6-c7ac-417e-ad57-e5d954c74092 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:45.460571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6eda6-c7ac-417e-ad57-e5d954c74092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:45.479429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-70c6eda6-c7ac-417e-ad57-e5d954c74092 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:45.482145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-70c6eda6-c7ac-417e-ad57-e5d954c74092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:45.596528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1169/2293] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:45.607482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:45.609400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:45.690599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9f088-d209-4f55-bd81-ddebfd0b74a6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:45.694420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:45.695103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:45.695388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:45.695828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:45.706796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:45.708512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:45.722947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1125/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:45.890177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:45.890482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:45.890756 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:45.913548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:45.914750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:45.923553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1170/2295] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:45.940580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:45.942038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:46.014149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:46.023570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:46.023756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13e215-ae7d-4875-860d-9c3d4e64ae3f service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:46.025209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:46.032974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:46.033764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:46.034113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:46.034742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:46.041380 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5fe5e-7e44-4790-b081-42084b62f3a3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:46.047293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:46.048178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:46.048461 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:46.048729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:46.048854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] PATH_INFO: `/v3/projects/d2de2932bef04f04935e84862fa65c1e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:46.050207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2de2932bef04f04935e84862fa65c1e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:46.050614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:46.052285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:46.061040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1126/2296] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:46.102291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:46.113761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2de2932bef04f04935e84862fa65c1e', 'request_id': 'req-1345c6de-9484-42bc-8fd4-93752fb239b5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.119422 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2de2932bef04f04935e84862fa65c1e', 'request_id': 'req-1345c6de-9484-42bc-8fd4-93752fb239b5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.127648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2de2932bef04f04935e84862fa65c1e', 'request_id': 'req-1345c6de-9484-42bc-8fd4-93752fb239b5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.141022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] The token cache is being invalidate because project d2de2932bef04f04935e84862fa65c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:46.141333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.142027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.143640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1171/2297] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:46 2022] DELETE /identity/v3/projects/d2de2932bef04f04935e84862fa65c1e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:41:46.147927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:46.158251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a387a-0273-4a48-93a8-aa396644cff0 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:46.216424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:46.217352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:46.217627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:46.217879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] PATH_INFO: `/v3/users/ce2b1bb4c8224c11986890ec2beab270` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:46.219100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2b1bb4c8224c11986890ec2beab270)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:46.221068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:46.274150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2b1bb4c8224c11986890ec2beab270'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.282682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2b1bb4c8224c11986890ec2beab270'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.283404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2b1bb4c8224c11986890ec2beab270'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.290907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2b1bb4c8224c11986890ec2beab270'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.291529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f74c032b-4ceb-4416-ab58-756e94e63f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2b1bb4c8224c11986890ec2beab270'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.308003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1127/2298] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:46 2022] DELETE /identity/v3/users/ce2b1bb4c8224c11986890ec2beab270 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:46.751838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:46.753518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:46.772576 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c6de-9484-42bc-8fd4-93752fb239b5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:46.831395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:46.832503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:46.832871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:46.833258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] PATH_INFO: `/v3/projects/16ced9861aa74a84abb3b03311d0258c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:46.834544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ced9861aa74a84abb3b03311d0258c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:46.836877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:46.893307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ced9861aa74a84abb3b03311d0258c', 'request_id': 'req-f44cab3d-ff15-45e0-99a8-8785f2349c88'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.899963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ced9861aa74a84abb3b03311d0258c', 'request_id': 'req-f44cab3d-ff15-45e0-99a8-8785f2349c88'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.908196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ced9861aa74a84abb3b03311d0258c', 'request_id': 'req-f44cab3d-ff15-45e0-99a8-8785f2349c88'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.920595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] The token cache is being invalidate because project 16ced9861aa74a84abb3b03311d0258c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:46.920973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.922696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f44cab3d-ff15-45e0-99a8-8785f2349c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:46.924317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1172/2299] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:46 2022] DELETE /identity/v3/projects/16ced9861aa74a84abb3b03311d0258c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:46.930664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:46.931047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:46.931395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:46.949544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:46.950734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:47.018649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1128/2300] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:47.026707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.026999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.027285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.046171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:47.047374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:47.055602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1173/2301] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:47.059739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.070063 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638ec67-f6da-48c7-b76e-74bf668d7db3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.075718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.076369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.076678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.076948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.077674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:41:47.077985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.079594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.086423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:47.095739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1129/2302] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:41:47.097446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.106924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae35b0f-55bb-432d-8fcb-7713d550f9ed None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.112889 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.113547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.113826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.114091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.114775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.116731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.145472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1174/2303] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:41:47 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:41:47.149597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.159920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae3012-8b7e-4594-a145-e7395bd3b2d0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.221205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.221890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.222203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.222481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.223198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.225155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.245885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1130/2304] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:41:47 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:41:47.250234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.260986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ba512-5ef8-4b55-803f-6982f2cfaf5a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.265653 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.266365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.266649 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.266922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.267651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.269426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.281478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1175/2305] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:47.285758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.295949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3aab-cf80-4688-bf78-9da914198961 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.301168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214b455-de24-4367-ae64-71c24b91bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.301769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214b455-de24-4367-ae64-71c24b91bd8c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.302049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214b455-de24-4367-ae64-71c24b91bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.302323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214b455-de24-4367-ae64-71c24b91bd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.303088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214b455-de24-4367-ae64-71c24b91bd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.304737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214b455-de24-4367-ae64-71c24b91bd8c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.315840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1131/2306] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:41:47.319992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.330513 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a131d-b318-491e-8293-ee359839cb0d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.336677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.337574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.337850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.338118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] PATH_INFO: `/v3/projects/4e94771fedfd4ab8b07dd53d5c270a27/users/4e44a455539148feb353c76efe7446b1/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.349643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:47.354599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e94771fedfd4ab8b07dd53d5c270a27, user_id=4e44a455539148feb353c76efe7446b1, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.357592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.373031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1176/2307] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:41:47 2022] PUT /identity/v3/projects/4e94771fedfd4ab8b07dd53d5c270a27/users/4e44a455539148feb353c76efe7446b1/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:47.384453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b3bd-6ff0-45a9-83f8-108e9897c575 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.384767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b3bd-6ff0-45a9-83f8-108e9897c575 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.385043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b3bd-6ff0-45a9-83f8-108e9897c575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.412773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5050b3bd-6ff0-45a9-83f8-108e9897c575 None None] MFA Rules not processed for user `4e44a455539148feb353c76efe7446b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:47.413977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5050b3bd-6ff0-45a9-83f8-108e9897c575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:47.488730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1132/2308] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:47.504733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:47.507686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:47.572888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6898a-f6e5-42a7-951b-1f6fd92850c2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:47.576748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdcc7c-b0e8-4426-b0a9-497f78ce23e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:47.577409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdcc7c-b0e8-4426-b0a9-497f78ce23e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.577694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdcc7c-b0e8-4426-b0a9-497f78ce23e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.577955 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdcc7c-b0e8-4426-b0a9-497f78ce23e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.587940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdcc7c-b0e8-4426-b0a9-497f78ce23e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:47.591333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdcc7c-b0e8-4426-b0a9-497f78ce23e9 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:47.599929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1177/2309] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:47.949824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:47.949940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:47.950274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:47.974807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] MFA Rules not processed for user `a7e1952279d048e0b8aa47037b127627`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:47.976182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:48.036808 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1133/2310] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:48.957177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:48.957688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:48.957940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:48.998101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:48.999443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:49.097028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1178/2311] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:49.116639 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:49.118350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:49.144365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:49.219705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4845-37f1-4d72-827a-63470de962f1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:49.226165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fc6d-dbed-4f6e-9b38-6b8fda959f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:49.226822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fc6d-dbed-4f6e-9b38-6b8fda959f16 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:49.227102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fc6d-dbed-4f6e-9b38-6b8fda959f16 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:49.227410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fc6d-dbed-4f6e-9b38-6b8fda959f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:49.238028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86fc6d-dbed-4f6e-9b38-6b8fda959f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:49.240015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86fc6d-dbed-4f6e-9b38-6b8fda959f16 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:49.250730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1134/2312] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:41:52.720581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:52.731375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0246e1a-537a-4c5c-b363-a801ba73a1c2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:52.736444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:52.737451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:52.737810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:52.738148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] PATH_INFO: `/v3/users/4e44a455539148feb353c76efe7446b1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:52.739459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e44a455539148feb353c76efe7446b1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:52.741504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:52.805299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e44a455539148feb353c76efe7446b1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:52.827751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e44a455539148feb353c76efe7446b1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:52.828592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e44a455539148feb353c76efe7446b1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:52.838598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e44a455539148feb353c76efe7446b1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:52.847686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e44a455539148feb353c76efe7446b1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:52.854680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1179/2313] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:41:52 2022] DELETE /identity/v3/users/4e44a455539148feb353c76efe7446b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:52.858947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce207b-41ff-4efa-b2ab-942962de6fb8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:52.859444 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce207b-41ff-4efa-b2ab-942962de6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:52.859565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce207b-41ff-4efa-b2ab-942962de6fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:52.877560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-95ce207b-41ff-4efa-b2ab-942962de6fb8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:52.879025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95ce207b-41ff-4efa-b2ab-942962de6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:52.944240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1135/2314] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:52.951980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:52.953665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:52.960527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:53.035478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b469ff-59ad-4ab4-b536-d2e9442be914 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:53.039848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:53.040548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:53.040831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:53.041102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:53.055695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:53.057198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:53.068543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1180/2315] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:53.155378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:53.156175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:53.156175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:53.176742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:53.177995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:53.187189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1136/2316] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:41:53.203265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:53.204867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:53.296908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f479-77c4-4903-b081-ce5f3fc30004 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:53.303682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8b6aa-df20-46b1-b9fc-bccda416981f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:53.304599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b6aa-df20-46b1-b9fc-bccda416981f service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:53.305437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b6aa-df20-46b1-b9fc-bccda416981f service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:53.305778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8b6aa-df20-46b1-b9fc-bccda416981f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:53.317023 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8b6aa-df20-46b1-b9fc-bccda416981f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:53.318938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8b6aa-df20-46b1-b9fc-bccda416981f service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:53.329658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1181/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:41:53.591367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:53.594314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:53.618026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c5b1-f58f-46a7-86b8-471704ff52d1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:53.622781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:53.623662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:53.623940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:53.624210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] PATH_INFO: `/v3/projects/4e94771fedfd4ab8b07dd53d5c270a27` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:53.625574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e94771fedfd4ab8b07dd53d5c270a27)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:53.627614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:53.676681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e94771fedfd4ab8b07dd53d5c270a27', 'request_id': 'req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:53.685962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e94771fedfd4ab8b07dd53d5c270a27', 'request_id': 'req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:53.692934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e94771fedfd4ab8b07dd53d5c270a27', 'request_id': 'req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:53.704006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] The token cache is being invalidate because project 4e94771fedfd4ab8b07dd53d5c270a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:41:53.704290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:53.704938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:41:53.706788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1137/2318] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:41:53 2022] DELETE /identity/v3/projects/4e94771fedfd4ab8b07dd53d5c270a27 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:41:57.372751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef2b1-60c1-4141-b24a-5d8cd69ac07c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:57.373291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef2b1-60c1-4141-b24a-5d8cd69ac07c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:57.373445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aef2b1-60c1-4141-b24a-5d8cd69ac07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:57.391825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-56aef2b1-60c1-4141-b24a-5d8cd69ac07c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:41:57.392963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-56aef2b1-60c1-4141-b24a-5d8cd69ac07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:57.472505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1182/2319] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:41:57.494828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:41:57.496445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:41:57.514079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:57.581474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65cb5b-5548-4307-8f0f-11ab1a8b603c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:41:57.587854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:41:57.588650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:41:57.589009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:41:57.589355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:41:57.600344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:41:57.602377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:41:57.614498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1138/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:00.249862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215af40-93aa-47d0-a5e4-64a440cab2f4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:00.250321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215af40-93aa-47d0-a5e4-64a440cab2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:00.250410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215af40-93aa-47d0-a5e4-64a440cab2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:00.267810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c215af40-93aa-47d0-a5e4-64a440cab2f4 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:00.269105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c215af40-93aa-47d0-a5e4-64a440cab2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:00.299384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:00.326268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1183/2321] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:00.368489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:00.370371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:00.448317 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c3a5-2f56-4903-bcae-727349d9c6cd service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:00.453476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:00.454137 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:00.454418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:00.454689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:00.462832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:00.464431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:00.472575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1139/2322] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:42:10.319629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:10.469668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=60 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:15.132168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a05d11-77d4-45df-9728-3987eb31e4f2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:15.132594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a05d11-77d4-45df-9728-3987eb31e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:15.132778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a05d11-77d4-45df-9728-3987eb31e4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:15.150933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-73a05d11-77d4-45df-9728-3987eb31e4f2 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:15.152152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-73a05d11-77d4-45df-9728-3987eb31e4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:15.164707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1184/2323] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:42:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:15.173505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:15.190937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4ed9-18f1-4b52-92fc-86985e80f2eb service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:15.196896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060716-95d8-4f2d-8daa-2a4267265fb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:15.197743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060716-95d8-4f2d-8daa-2a4267265fb1 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:15.198010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060716-95d8-4f2d-8daa-2a4267265fb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:15.198472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060716-95d8-4f2d-8daa-2a4267265fb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:15.207469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6060716-95d8-4f2d-8daa-2a4267265fb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:15.209182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6060716-95d8-4f2d-8daa-2a4267265fb1 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:15.217785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1140/2324] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:42:16.390180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc7440-c8f7-41c3-96eb-47058ec4135b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.391217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc7440-c8f7-41c3-96eb-47058ec4135b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.391491 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc7440-c8f7-41c3-96eb-47058ec4135b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.393501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1185/2325] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:42:16.400320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.400836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.400945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.437279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830f1be-8b0b-456c-9dd3-3ec1acd81377 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.437552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830f1be-8b0b-456c-9dd3-3ec1acd81377 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.437982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830f1be-8b0b-456c-9dd3-3ec1acd81377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.467398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6830f1be-8b0b-456c-9dd3-3ec1acd81377 None None] MFA Rules not processed for user `66c0c813f2d24653a3b2dd5557d20998`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:16.467825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:16.469285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:16.470615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6830f1be-8b0b-456c-9dd3-3ec1acd81377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:16.494394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1141/2326] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:16.501044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:16.506145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:16.589091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1186/2327] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:16.616152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f541b15-a17e-404b-9b69-0aa29ef22fbb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:16.620683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baf54f-4b7e-48f0-bcd4-8dc019c21f48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:16.621493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf54f-4b7e-48f0-bcd4-8dc019c21f48 service glance] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.621941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf54f-4b7e-48f0-bcd4-8dc019c21f48 service glance] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.622357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf54f-4b7e-48f0-bcd4-8dc019c21f48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.635721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baf54f-4b7e-48f0-bcd4-8dc019c21f48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:16.637379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baf54f-4b7e-48f0-bcd4-8dc019c21f48 service glance] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:16.662060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1142/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:42:16.768325 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886c941-f984-468f-99bf-915aca69285a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.768702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886c941-f984-468f-99bf-915aca69285a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.768983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886c941-f984-468f-99bf-915aca69285a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.770813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1187/2329] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:42:16.778050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d4e4-133f-4865-acfb-aa053e96c982 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.778327 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d4e4-133f-4865-acfb-aa053e96c982 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.778606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d4e4-133f-4865-acfb-aa053e96c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.798852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4715d4e4-133f-4865-acfb-aa053e96c982 None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:16.800466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4715d4e4-133f-4865-acfb-aa053e96c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:16.876786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1143/2330] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:16.889370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886c941-f984-468f-99bf-915aca69285a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:16.891269 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1886c941-f984-468f-99bf-915aca69285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:16.906001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886c941-f984-468f-99bf-915aca69285a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:16.910999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d94d1-bb31-4531-8049-97149dd89163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:16.911848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d94d1-bb31-4531-8049-97149dd89163 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:16.912125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d94d1-bb31-4531-8049-97149dd89163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:16.912598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d94d1-bb31-4531-8049-97149dd89163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:16.921915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d94d1-bb31-4531-8049-97149dd89163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:16.925878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d94d1-bb31-4531-8049-97149dd89163 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:16.937070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1188/2331] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:17.046596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d304-81c8-44d4-b76b-a79a0467e135 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:17.046880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d304-81c8-44d4-b76b-a79a0467e135 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:17.047155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d304-81c8-44d4-b76b-a79a0467e135 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:17.048932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1144/2332] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:42:17.054727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cdfff-a00a-4168-bb80-4caade79bd1c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:17.055024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cdfff-a00a-4168-bb80-4caade79bd1c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:17.055315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cdfff-a00a-4168-bb80-4caade79bd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:17.078288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ed7cdfff-a00a-4168-bb80-4caade79bd1c None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:17.079746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ed7cdfff-a00a-4168-bb80-4caade79bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:17.090390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1189/2333] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:42:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:42:17.102032 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d304-81c8-44d4-b76b-a79a0467e135 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:17.113991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d304-81c8-44d4-b76b-a79a0467e135 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:17.120173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:17.120911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:17.121170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:17.123687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:17.138817 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:17.140681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:17.167831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1145/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:22.762810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c603bf-7068-4cc5-b2ec-ea4740a7ddd1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:22.763810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c603bf-7068-4cc5-b2ec-ea4740a7ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:22.764275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c603bf-7068-4cc5-b2ec-ea4740a7ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:22.786489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-74c603bf-7068-4cc5-b2ec-ea4740a7ddd1 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:22.787819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-74c603bf-7068-4cc5-b2ec-ea4740a7ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:22.803350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1190/2335] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:42:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:22.820823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:22.846997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72730c-c7a0-4421-b537-65bebd0c851d service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:22.853617 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:22.855373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:22.856308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:22.857163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:22.868825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:22.870953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:22.881105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1146/2336] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:42:32.779665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=40 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:32.876866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=70 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:33.830255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:33.830752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:33.830860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:33.848886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:33.850092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:33.857338 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1191/2337] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jul 21 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:33.872859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:33.886921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7c093-0155-4bd4-9e03-8ee55326838a service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:33.893752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:33.894467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:33.894753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:33.895072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:33.904066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:33.905796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:33.917909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1147/2338] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:42:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:42:36.315383 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:36.325340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:36.341532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bea86f-de42-4a40-9a46-595df59e8354 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:36.346892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:36.347841 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:36.348116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:36.348391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] PATH_INFO: `/v3/users/a7e1952279d048e0b8aa47037b127627` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:36.349669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e1952279d048e0b8aa47037b127627)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:36.352035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:36.399478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e1952279d048e0b8aa47037b127627'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.411324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e1952279d048e0b8aa47037b127627'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.412001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e1952279d048e0b8aa47037b127627'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.420340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e1952279d048e0b8aa47037b127627'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.427707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-58eaa657-8526-447b-9f53-4ca1c7be7d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e1952279d048e0b8aa47037b127627'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.433792 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1192/2339] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:42:36 2022] DELETE /identity/v3/users/a7e1952279d048e0b8aa47037b127627 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:42:36.606362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:36.618294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef1afe-c4e4-4d1c-91d1-474e3f381f21 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:36.675750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:36.676663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:36.676950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:36.677224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] PATH_INFO: `/v3/projects/7d092186420e4390aa6b6c95ea2abe08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:36.678510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d092186420e4390aa6b6c95ea2abe08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:36.680434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:36.738189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d092186420e4390aa6b6c95ea2abe08', 'request_id': 'req-4f4d19cc-b295-439e-aaa4-6125906495a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.747165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d092186420e4390aa6b6c95ea2abe08', 'request_id': 'req-4f4d19cc-b295-439e-aaa4-6125906495a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.753946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d092186420e4390aa6b6c95ea2abe08', 'request_id': 'req-4f4d19cc-b295-439e-aaa4-6125906495a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.765042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] The token cache is being invalidate because project 7d092186420e4390aa6b6c95ea2abe08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:42:36.765344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.765968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4f4d19cc-b295-439e-aaa4-6125906495a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:42:36.767880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1148/2340] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:42:36 2022] DELETE /identity/v3/projects/7d092186420e4390aa6b6c95ea2abe08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:42:36.772947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:36.773249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:36.773530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:36.792614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:36.793845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:36.873845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1193/2341] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:36.876816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:36.877176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:36.877558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:36.899791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:36.901085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:36.909469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1149/2342] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:36.913799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:36.923503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2050a6-7133-4860-ad97-74fff40e2a16 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:36.928129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:36.928824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:36.929108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:36.929384 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:36.930128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:42:36.930437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:36.932093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:36.943561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1194/2343] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:42:36.948337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:36.962673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d415a-6bfb-434b-8398-15aac1192f6c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:36.970199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:36.971236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:36.971695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:36.972196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:36.973347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:36.975961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:37.003126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1150/2344] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:42:36 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:42:37.009585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:37.021867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ff459-c8f0-4146-ae70-3db14b660158 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:37.071508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:37.082561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:37.083342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:37.083658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:37.083941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:37.084880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:37.087370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:37.108329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1195/2345] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:42:37 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:42:37.113697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:37.124225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4fec7-81cf-408e-9a6f-54457111ea47 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:37.129472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:37.130707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:37.130707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:37.130707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:37.131525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:37.133282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:37.145670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1151/2346] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:42:37.150526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:37.161966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0520e-0eb2-413f-982f-b35a0c093b84 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:37.166855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c27671-641d-4301-8ed2-1c5eb18de5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:37.167522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27671-641d-4301-8ed2-1c5eb18de5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:37.167807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27671-641d-4301-8ed2-1c5eb18de5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:37.168090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27671-641d-4301-8ed2-1c5eb18de5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:37.168836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27671-641d-4301-8ed2-1c5eb18de5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:37.174903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27671-641d-4301-8ed2-1c5eb18de5fa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:37.186360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1196/2347] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:42:37.190498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:37.201598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50be177-af19-41dd-bbb8-e5e08bedcbab admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:37.206454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:37.207383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:37.207661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:37.207932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] PATH_INFO: `/v3/projects/d09256fb82cd4ac4abbfeb825ae91eeb/users/1f8e09d9279f493b85ec057db1c43d04/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:37.223495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09256fb82cd4ac4abbfeb825ae91eeb, user_id=1f8e09d9279f493b85ec057db1c43d04, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:37.226991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:37.242720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1152/2348] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:42:37 2022] PUT /identity/v3/projects/d09256fb82cd4ac4abbfeb825ae91eeb/users/1f8e09d9279f493b85ec057db1c43d04/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:42:37.322051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb069-bcff-44fa-81c0-63ea81dd1411 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:37.322569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb069-bcff-44fa-81c0-63ea81dd1411 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:37.322569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb069-bcff-44fa-81c0-63ea81dd1411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:37.350437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d8ceb069-bcff-44fa-81c0-63ea81dd1411 None None] MFA Rules not processed for user `1f8e09d9279f493b85ec057db1c43d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:37.351729 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d8ceb069-bcff-44fa-81c0-63ea81dd1411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:37.423122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1197/2349] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:42:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:37.435809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:37.437551 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:37.451657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:37.502142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb65e-3171-46e4-8139-848a98af72b2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:37.505755 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:37.506470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:37.506753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:37.507021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:37.515449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:37.516923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:37.527093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1153/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:40.257600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515d49-dbed-442e-9093-e7af5ea555b3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:40.258155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515d49-dbed-442e-9093-e7af5ea555b3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:40.258155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515d49-dbed-442e-9093-e7af5ea555b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:40.277607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f4515d49-dbed-442e-9093-e7af5ea555b3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:40.278775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f4515d49-dbed-442e-9093-e7af5ea555b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:40.345816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1198/2351] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:40.367875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:40.369407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:40.452058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91d759-74b0-42c8-9e3f-02683085a851 service glance] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:40.457689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:40.458367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:40.458653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:40.459048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:40.468596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:40.470215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:40.479748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1154/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:42:41.756616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae91b-1495-4a83-9daa-093c96820c99 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:41.757162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae91b-1495-4a83-9daa-093c96820c99 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:41.757162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ae91b-1495-4a83-9daa-093c96820c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:41.776527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-273ae91b-1495-4a83-9daa-093c96820c99 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:41.777754 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-273ae91b-1495-4a83-9daa-093c96820c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:41.836629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1199/2353] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jul 21 05:42:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:41.849377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:41.851085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:41.925634 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5e02-ea8e-407e-bbe2-2de1d26b08c2 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:41.932017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:41.932727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:41.933006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:41.933276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:41.942128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:41.943716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:41.952797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1155/2354] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:42:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:42:44.579225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637dc92-acfb-4f17-8f53-8c6ccfa1d1a7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:44.579820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637dc92-acfb-4f17-8f53-8c6ccfa1d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:44.579820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637dc92-acfb-4f17-8f53-8c6ccfa1d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:44.593448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:44.599658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f637dc92-acfb-4f17-8f53-8c6ccfa1d1a7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:44.601487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f637dc92-acfb-4f17-8f53-8c6ccfa1d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:44.609609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1200/2355] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:44.627989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:44.629593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:44.645449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9221d-250e-4f2a-a5df-37e04faea020 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:44.651543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:44.652303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:44.652610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:44.652879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:44.662303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:44.663951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:44.674004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1156/2356] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:47.628456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671022-89bd-458f-bcf0-a842ed5f5e92 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:47.629323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671022-89bd-458f-bcf0-a842ed5f5e92 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:47.629479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671022-89bd-458f-bcf0-a842ed5f5e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:47.653665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4a671022-89bd-458f-bcf0-a842ed5f5e92 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:47.654852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a671022-89bd-458f-bcf0-a842ed5f5e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:47.664629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1201/2357] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:47.684887 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:47.696520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6513a-a453-443e-96f9-4933201e803c service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:47.703726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:47.704381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:47.704690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:47.704963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:47.714134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:47.715736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:47.725492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1157/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:50.800892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62c41a-4225-41d9-a216-86c81be5f99b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:50.801436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62c41a-4225-41d9-a216-86c81be5f99b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:50.801702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62c41a-4225-41d9-a216-86c81be5f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:50.826888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4f62c41a-4225-41d9-a216-86c81be5f99b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:50.828090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4f62c41a-4225-41d9-a216-86c81be5f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:50.836501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1202/2359] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:50.858785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:50.865913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:42:50.870783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4221a9-95e1-45aa-ac19-0c74e94c2e3b service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:50.877125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:50.877770 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:50.878102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:50.878467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:50.890276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:50.891879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:50.902995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1158/2360] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:53.954438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:53.954933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:53.955036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:53.974176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:42:53.975471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:53.985030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1203/2361] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jul 21 05:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:42:54.001188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:54.014304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc6a4-05eb-40f4-9737-a1d82cddeb5e service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:54.020169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:54.020911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:54.021283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:54.022798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:54.030661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:54.032718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:54.044190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1159/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:42:59.224160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:42:59.225766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:59.300414 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc76524-964c-4db1-a9f9-57e4165dd32d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:42:59.306024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:42:59.306886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:42:59.307204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:42:59.307475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:42:59.309437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:42:59.323666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:42:59.325839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fde81c-ff57-4040-9b77-15a41666effe service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:42:59.338030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1204/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:42:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:03.595457 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:03.605624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ec19-bf61-467b-bb8a-05dda5e61834 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:03.611658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:03.612536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:03.612964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:03.613066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] PATH_INFO: `/v3/users/1f8e09d9279f493b85ec057db1c43d04` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:03.614396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8e09d9279f493b85ec057db1c43d04)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:03.616319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:03.666499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8e09d9279f493b85ec057db1c43d04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:03.675529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8e09d9279f493b85ec057db1c43d04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:03.676246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8e09d9279f493b85ec057db1c43d04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:03.683734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8e09d9279f493b85ec057db1c43d04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:03.684412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8e09d9279f493b85ec057db1c43d04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:03.703739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1160/2364] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:43:03 2022] DELETE /identity/v3/users/1f8e09d9279f493b85ec057db1c43d04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:03.708466 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:03.709011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:03.709011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:03.727098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:03.728273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:03.789590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1205/2365] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:03.799545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:03.801256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:03.862723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030cea1-11ee-48aa-9008-75ab38ad87d3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:03.867458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5311d-4352-4c4f-8d86-f5b5d52acc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:03.868598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5311d-4352-4c4f-8d86-f5b5d52acc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:03.868903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5311d-4352-4c4f-8d86-f5b5d52acc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:03.869179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5311d-4352-4c4f-8d86-f5b5d52acc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:03.880043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5311d-4352-4c4f-8d86-f5b5d52acc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:03.881525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5311d-4352-4c4f-8d86-f5b5d52acc49 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:03.891159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1161/2366] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:04.190776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.192784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:04.209776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b02b19-99c0-4751-935f-99f4c3050479 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.215945 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.217167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.217451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.217733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] PATH_INFO: `/v3/projects/d09256fb82cd4ac4abbfeb825ae91eeb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.219030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09256fb82cd4ac4abbfeb825ae91eeb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.221104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.287815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09256fb82cd4ac4abbfeb825ae91eeb', 'request_id': 'req-494fda64-6cb3-4689-9981-fbb0c3e66cda'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:04.294712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09256fb82cd4ac4abbfeb825ae91eeb', 'request_id': 'req-494fda64-6cb3-4689-9981-fbb0c3e66cda'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:04.307005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09256fb82cd4ac4abbfeb825ae91eeb', 'request_id': 'req-494fda64-6cb3-4689-9981-fbb0c3e66cda'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:04.309143 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:04.331364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] The token cache is being invalidate because project d09256fb82cd4ac4abbfeb825ae91eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:43:04.331661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:04.332334 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-494fda64-6cb3-4689-9981-fbb0c3e66cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:04.334129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1206/2367] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:43:04 2022] DELETE /identity/v3/projects/d09256fb82cd4ac4abbfeb825ae91eeb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:04.338966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.339253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.339529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.358303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:04.359531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:04.407993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:04.421610 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1162/2368] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:04.429442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.429731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.430001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.448058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:04.449273 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:04.457028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1207/2369] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:04.461139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.470897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c94e21-5501-4f3c-ba2a-90ae15d13c3c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.475373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.476033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.476319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.476630 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.477368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:43:04.477706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.479351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.491101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1163/2370] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:43:04.497689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.508108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2c7ee-b132-469b-a828-9ba22ad8f92a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.513052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.513707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.513992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.514266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.514951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.516925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.546148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1208/2371] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:43:04 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:04.550388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.560695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3c9fd-f138-46ca-8a37-68f2bc1d03af admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.619800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.620448 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.620767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.621041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.621738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.623693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.644938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1164/2372] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:43:04 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:04.649030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.659606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85acf0-f7de-4d16-91e1-8b09e201bc7b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.664282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.664991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.665256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.665528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.666256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.667876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.679559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1209/2373] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:43:04.683717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.693978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63221-d3a5-42f2-98c8-fef7bbf34b1c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.698880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f106fb8-b0a4-407b-b173-36854751eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.699539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106fb8-b0a4-407b-b173-36854751eed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.699931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106fb8-b0a4-407b-b173-36854751eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.700211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f106fb8-b0a4-407b-b173-36854751eed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.700993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f106fb8-b0a4-407b-b173-36854751eed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.702584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f106fb8-b0a4-407b-b173-36854751eed2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.712693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1165/2374] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:04.716896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.727379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bf4b-e6c4-463a-a195-8cbfb28211a7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.732453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.733340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.733624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.734010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] PATH_INFO: `/v3/projects/d3b3a4fff60e4bbc91d82906b058e464/users/12171e7dbdeb440ebe9a95729e144c44/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.748896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b3a4fff60e4bbc91d82906b058e464, user_id=12171e7dbdeb440ebe9a95729e144c44, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.751626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.765590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1210/2375] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:43:04 2022] PUT /identity/v3/projects/d3b3a4fff60e4bbc91d82906b058e464/users/12171e7dbdeb440ebe9a95729e144c44/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:04.776162 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed18d-f566-4311-b557-9df5c585d217 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.776506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed18d-f566-4311-b557-9df5c585d217 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.776809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed18d-f566-4311-b557-9df5c585d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.805344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f77ed18d-f566-4311-b557-9df5c585d217 None None] MFA Rules not processed for user `12171e7dbdeb440ebe9a95729e144c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:04.806472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f77ed18d-f566-4311-b557-9df5c585d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:04.873359 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1166/2376] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:43:04.885176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:04.887223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:04.943664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a4e3d-6357-4759-9bf2-988e33bb412f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:04.947616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:04.948254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:04.948554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:04.948828 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:04.957474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:04.958910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:04.967793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1211/2377] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:09.413178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:09.413713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:09.413809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:09.432149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] MFA Rules not processed for user `880de431d70d4b35af04a043d7359661`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:09.433751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:09.479380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:09.494653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1167/2378] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:14.963899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:19.491265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:26.817037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:26.818572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:26.888541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bed71c-70eb-4ac1-aef8-172f5571dbd0 service glance] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:26.893418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:26.894309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:26.894584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:26.894885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] PATH_INFO: `/v3/users/66c0c813f2d24653a3b2dd5557d20998` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:26.896078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c0c813f2d24653a3b2dd5557d20998)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:26.898092 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:26.947449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c0c813f2d24653a3b2dd5557d20998'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:26.961013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c0c813f2d24653a3b2dd5557d20998'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:26.961665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c0c813f2d24653a3b2dd5557d20998'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:26.969519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c0c813f2d24653a3b2dd5557d20998'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:26.976895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50f253eb-c907-4c52-b547-1691501f96b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c0c813f2d24653a3b2dd5557d20998'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:26.983078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1212/2379] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:43:26 2022] DELETE /identity/v3/users/66c0c813f2d24653a3b2dd5557d20998 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:27.167991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.179594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03d38-8664-4aee-b291-90cfe01d9c7a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.239919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.240760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.241034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.241314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] PATH_INFO: `/v3/projects/ef882a1dbf5041d9bc5926dbbdb29e7a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.242485 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef882a1dbf5041d9bc5926dbbdb29e7a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.244403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.292286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef882a1dbf5041d9bc5926dbbdb29e7a', 'request_id': 'req-cf1148c0-7fdd-4e3e-9046-e74685c9179a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:27.300123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef882a1dbf5041d9bc5926dbbdb29e7a', 'request_id': 'req-cf1148c0-7fdd-4e3e-9046-e74685c9179a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:27.306428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef882a1dbf5041d9bc5926dbbdb29e7a', 'request_id': 'req-cf1148c0-7fdd-4e3e-9046-e74685c9179a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:27.318853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] The token cache is being invalidate because project ef882a1dbf5041d9bc5926dbbdb29e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:43:27.319142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:27.319927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf1148c0-7fdd-4e3e-9046-e74685c9179a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:27.321646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1168/2380] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:43:27 2022] DELETE /identity/v3/projects/ef882a1dbf5041d9bc5926dbbdb29e7a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:43:27.326704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.327069 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.327409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.348087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:27.349343 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:27.408658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1213/2381] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:27.418588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.418879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.419156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.438191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:27.439515 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:27.448226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1169/2382] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:27.452764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.463124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa472ba-c5ac-45f3-a403-1ecd6ec69d19 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.471360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.471360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.471360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.471360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.471733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:43:27.471733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.472950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.485357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1214/2383] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:43:27.490189 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.499890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46850d65-a2c5-4623-bcdd-bfec03ff2b4e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.505383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.506047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.506328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.506598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.507318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.509292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.542642 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1170/2384] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:27.543834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.553927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfd791-1384-4034-ad92-ac65ace09fb1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.557876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:27.617296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.617447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.617725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.618074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.618795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.620895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.641413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1215/2385] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:27.646172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.656776 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56fd0-11c2-4bfc-9817-03020cc70c14 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.661688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.662347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.662625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.662894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.663621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.665282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.675771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1171/2386] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:27.679977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.690714 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828527e-cf29-41fa-bd3c-6d00b8e9e992 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.695505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa40fc-6d78-42ea-9a18-7e528b8dd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.696172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa40fc-6d78-42ea-9a18-7e528b8dd15a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.696497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa40fc-6d78-42ea-9a18-7e528b8dd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.696921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa40fc-6d78-42ea-9a18-7e528b8dd15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.697660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa40fc-6d78-42ea-9a18-7e528b8dd15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.699267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa40fc-6d78-42ea-9a18-7e528b8dd15a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.709980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1216/2387] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:27.714585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.725253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886288-7c1c-4d03-a9be-c1eb534fca53 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.730936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.731842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.732127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.732400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] PATH_INFO: `/v3/projects/077809d2ee0142d3b2a4f7210d5db63c/users/b68435c0020b4a0ba9daba0140c075dd/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.750311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] RBAC: Authorizing `identity:create_grant(project_id=077809d2ee0142d3b2a4f7210d5db63c, user_id=b68435c0020b4a0ba9daba0140c075dd, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.752992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.767062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1172/2388] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:43:27 2022] PUT /identity/v3/projects/077809d2ee0142d3b2a4f7210d5db63c/users/b68435c0020b4a0ba9daba0140c075dd/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:43:27.777413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.777737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.778033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.807601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] MFA Rules not processed for user `b68435c0020b4a0ba9daba0140c075dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:27.808850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:27.877235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1217/2389] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:27.888294 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:27.890321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:27.923637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:27.953313 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482567d1-969c-44ac-bedf-e18db51e618f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:27.957578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9519-a5ae-48a1-ac4b-1a718fb722e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:27.958229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9519-a5ae-48a1-ac4b-1a718fb722e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:27.958526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9519-a5ae-48a1-ac4b-1a718fb722e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:27.958799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9519-a5ae-48a1-ac4b-1a718fb722e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:27.967304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9519-a5ae-48a1-ac4b-1a718fb722e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:27.968772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9519-a5ae-48a1-ac4b-1a718fb722e5 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:27.977539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1173/2390] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:29.734297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:29.737039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:29.815410 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ef76d-3c4c-4194-b6d4-5c40928ddfbd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:29.820722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:29.821599 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:29.821884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:29.822159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] PATH_INFO: `/v3/users/12171e7dbdeb440ebe9a95729e144c44` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:29.823379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12171e7dbdeb440ebe9a95729e144c44)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:29.825365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:29.841157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:29.875095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12171e7dbdeb440ebe9a95729e144c44'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:29.887365 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12171e7dbdeb440ebe9a95729e144c44'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:29.888070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12171e7dbdeb440ebe9a95729e144c44'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:29.896652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12171e7dbdeb440ebe9a95729e144c44'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:29.903489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12171e7dbdeb440ebe9a95729e144c44'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:29.910022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1218/2391] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:43:29 2022] DELETE /identity/v3/users/12171e7dbdeb440ebe9a95729e144c44 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:29.914866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:29.915414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:29.915414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:29.933045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:29.934238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:29.998526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1174/2392] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:30.010286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:30.011886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:30.073869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c37f-27d4-423a-8ca6-4a7bc265b646 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:30.078620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:30.079279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:30.079658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:30.080024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:30.091140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:30.092630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:30.102180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1219/2393] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:30.379033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:30.380664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:30.395269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1789f-c48f-41ad-8938-806e3a82df99 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:30.400785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:30.401674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:30.401951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:30.402219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] PATH_INFO: `/v3/projects/d3b3a4fff60e4bbc91d82906b058e464` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:30.403529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b3a4fff60e4bbc91d82906b058e464)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:30.406325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:30.460580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b3a4fff60e4bbc91d82906b058e464', 'request_id': 'req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:30.468193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b3a4fff60e4bbc91d82906b058e464', 'request_id': 'req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:30.474577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b3a4fff60e4bbc91d82906b058e464', 'request_id': 'req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:30.485653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] The token cache is being invalidate because project d3b3a4fff60e4bbc91d82906b058e464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:43:30.485942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:30.486548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0136db2d-6aad-4ca5-b7a6-991976cdbe1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:30.488098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1175/2394] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:43:30 2022] DELETE /identity/v3/projects/d3b3a4fff60e4bbc91d82906b058e464 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:38.190160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:38.191775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:38.205570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995751a-dd4c-4a3f-83e9-f064a4a926f7 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:38.264433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:38.265356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:38.265638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:38.265914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] PATH_INFO: `/v3/users/b68435c0020b4a0ba9daba0140c075dd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:38.267150 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68435c0020b4a0ba9daba0140c075dd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:38.269170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:38.313574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:38.320180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68435c0020b4a0ba9daba0140c075dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.332610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68435c0020b4a0ba9daba0140c075dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.333279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68435c0020b4a0ba9daba0140c075dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.340678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68435c0020b4a0ba9daba0140c075dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.348894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68435c0020b4a0ba9daba0140c075dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.355473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1220/2395] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:43:38 2022] DELETE /identity/v3/users/b68435c0020b4a0ba9daba0140c075dd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:38.360039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:38.360611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:38.360611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:38.380541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:38.381864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:38.434203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:38.448043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1176/2396] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:38.457588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:38.459128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:38.515863 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6952a-26d9-48f7-8db5-8bb3a21c1f84 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:38.519643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13509607-f2f2-41ad-b5cb-93df846e2aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:38.520286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13509607-f2f2-41ad-b5cb-93df846e2aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:38.520592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13509607-f2f2-41ad-b5cb-93df846e2aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:38.520868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13509607-f2f2-41ad-b5cb-93df846e2aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:38.530704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13509607-f2f2-41ad-b5cb-93df846e2aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:38.532251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13509607-f2f2-41ad-b5cb-93df846e2aaf service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:38.542082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1221/2397] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:38.821158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:38.822991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:38.835638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee075ed-fd90-4f6b-9294-eb6337e14b1f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:38.852699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:38.853620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:38.853924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:38.854201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] PATH_INFO: `/v3/projects/077809d2ee0142d3b2a4f7210d5db63c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:38.857602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077809d2ee0142d3b2a4f7210d5db63c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:38.860464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:38.919788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077809d2ee0142d3b2a4f7210d5db63c', 'request_id': 'req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.928614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077809d2ee0142d3b2a4f7210d5db63c', 'request_id': 'req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.935895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077809d2ee0142d3b2a4f7210d5db63c', 'request_id': 'req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.946512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] The token cache is being invalidate because project 077809d2ee0142d3b2a4f7210d5db63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:43:38.946800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.947441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-03c6c52a-a4d6-4f4c-8d14-e24a09258eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:43:38.949022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1177/2398] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:43:38 2022] DELETE /identity/v3/projects/077809d2ee0142d3b2a4f7210d5db63c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:38.954350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:38.954636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:38.954912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:38.974037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:38.975990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:39.040404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1222/2399] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:39.049541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.049925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.050271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.091753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:39.093394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:39.102395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1178/2400] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:39.106761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.121600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289c35-6847-450e-abb8-60a81f3d9490 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.127555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.128718 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.129091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.129432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.130301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:43:39.130773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.132890 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.161922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1223/2401] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:43:39.163857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.179300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ab02-3832-47ff-8f8e-714944509c35 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.185954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.186723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.187106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.187383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.189354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.191866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.224061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1179/2402] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:43:39 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:39.227850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.241515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ac5e4-6aee-4d82-837f-a93d448e81ea admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.294020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:39.311701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.312620 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.312936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.313327 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.314337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.316879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.341110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1224/2403] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:43:39 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:43:39.345247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.356145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a058d-9945-4c28-b116-8540256101b0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.362969 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.363710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.363975 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.364249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.365223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.367255 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.379818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1180/2404] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:39.383888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.395035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c582098-57cb-47f4-a343-30f14f74438d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.399739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3fe41-c702-4051-8b38-1af5769b14f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.400413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3fe41-c702-4051-8b38-1af5769b14f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.400833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3fe41-c702-4051-8b38-1af5769b14f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.401130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3fe41-c702-4051-8b38-1af5769b14f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.401855 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3fe41-c702-4051-8b38-1af5769b14f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.403492 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3fe41-c702-4051-8b38-1af5769b14f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.414682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1225/2405] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:43:39.418643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.429806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664bdbe-7f8d-4bb3-9aa9-38a70bdc16a2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.435028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.435972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.436256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.436570 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] PATH_INFO: `/v3/projects/1643b6c460de4711823f725fd61718a4/users/92074e992399406c969d11eb97bff469/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.452141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1643b6c460de4711823f725fd61718a4, user_id=92074e992399406c969d11eb97bff469, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.454879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.470220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1181/2406] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:43:39 2022] PUT /identity/v3/projects/1643b6c460de4711823f725fd61718a4/users/92074e992399406c969d11eb97bff469/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:39.475278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a139-420a-44a5-a7a0-cb721feec6cb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.475574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a139-420a-44a5-a7a0-cb721feec6cb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.475854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a139-420a-44a5-a7a0-cb721feec6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.493812 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2ce1a139-420a-44a5-a7a0-cb721feec6cb None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:39.495033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ce1a139-420a-44a5-a7a0-cb721feec6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:39.560439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1226/2407] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:39.571114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:39.573252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:39.643529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313be5f-af17-47ef-aac7-68ffabe81592 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:39.649290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f370233-74ae-4b37-8fb7-81a1791e9930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:39.650276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370233-74ae-4b37-8fb7-81a1791e9930 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:39.650559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370233-74ae-4b37-8fb7-81a1791e9930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:39.650841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370233-74ae-4b37-8fb7-81a1791e9930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:39.663583 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f370233-74ae-4b37-8fb7-81a1791e9930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:39.665498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f370233-74ae-4b37-8fb7-81a1791e9930 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:39.684454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1182/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:43.107314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:43.108322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:43.108935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:43.131423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] MFA Rules not processed for user `6bea3f54f3b2472480f16b6947598ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:43.133115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:43.202529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1227/2409] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:45.404565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.405101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.405101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.446079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] MFA Rules not processed for user `92074e992399406c969d11eb97bff469`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:45.447680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:45.452852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:45.556112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1183/2410] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:45.560707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:45.575337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc348-ac18-4024-874d-ff30238202b9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:45.581919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:45.582761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.583107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.583562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.584690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:45.587670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:45.627490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1228/2411] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:43:45 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:43:45.628988 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:45.649009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef072ec6-d396-4fab-8771-536b30eebe41 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:45.731024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:45.731862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.732204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.732574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.733393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:45.736746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:45.763156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1184/2412] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:43:45 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:43:45.767126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:45.779847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193520ca-f579-4bb9-9b4e-abd5b81e891e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:45.785212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:45.785887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.786172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.786577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.787373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:45.789677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:45.804427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1229/2413] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:45.805611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:45.815889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530fb5c-6c36-4e36-938e-1987cf66d7a8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:45.820628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:45.821529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.821812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.822113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] PATH_INFO: `/v3/projects/555e582807ee49aca6d226a6243b2ac7/users/5ae53b91e0ed4196918c1c5b051d774c/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.837874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555e582807ee49aca6d226a6243b2ac7, user_id=5ae53b91e0ed4196918c1c5b051d774c, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:45.841237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:45.854627 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1185/2414] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:43:45 2022] PUT /identity/v3/projects/555e582807ee49aca6d226a6243b2ac7/users/5ae53b91e0ed4196918c1c5b051d774c/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:43:45.858651 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:45.871029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653fb4-8be8-48e2-81e2-007e610bcd7b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:45.909689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:45.936100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab9849-7aed-4e21-b5ed-f3399c5bb683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:45.936819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9849-7aed-4e21-b5ed-f3399c5bb683 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.937098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9849-7aed-4e21-b5ed-f3399c5bb683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.937369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9849-7aed-4e21-b5ed-f3399c5bb683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.938093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab9849-7aed-4e21-b5ed-f3399c5bb683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:45.939731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab9849-7aed-4e21-b5ed-f3399c5bb683 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:45.950711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1230/2415] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:43:45.954798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:45.965869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dd6d4-b519-4edf-9068-df615606a3c4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:45.970838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:45.971768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:45.972044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:45.972312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] PATH_INFO: `/v3/projects/555e582807ee49aca6d226a6243b2ac7/users/5ae53b91e0ed4196918c1c5b051d774c/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:45.974382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555e582807ee49aca6d226a6243b2ac7, user_id=5ae53b91e0ed4196918c1c5b051d774c, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:45.977102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:45.988203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1186/2416] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:43:45 2022] PUT /identity/v3/projects/555e582807ee49aca6d226a6243b2ac7/users/5ae53b91e0ed4196918c1c5b051d774c/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:43:50.869404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f46ff5-a3cf-4814-b5e4-0ef15750a775 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:50.869925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f46ff5-a3cf-4814-b5e4-0ef15750a775 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:50.869925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f46ff5-a3cf-4814-b5e4-0ef15750a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:50.897573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a6f46ff5-a3cf-4814-b5e4-0ef15750a775 None None] MFA Rules not processed for user `5ae53b91e0ed4196918c1c5b051d774c`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:50.898788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6f46ff5-a3cf-4814-b5e4-0ef15750a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:50.969625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1231/2417] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:43:50.983968 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:43:50.985822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:51.044143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:51.064450 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04b6a-d1bc-481e-b9d9-024d8342adf4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:43:51.070339 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfdb68-0b3e-452b-a610-21d4535c5888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:43:51.071000 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfdb68-0b3e-452b-a610-21d4535c5888 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:51.071281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfdb68-0b3e-452b-a610-21d4535c5888 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:51.071552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfdb68-0b3e-452b-a610-21d4535c5888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:51.129042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfdb68-0b3e-452b-a610-21d4535c5888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:43:51.130678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfdb68-0b3e-452b-a610-21d4535c5888 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:43:51.139863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1187/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:43:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:43:52.465008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:43:52.465570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:43:52.465570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:43:52.483607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] MFA Rules not processed for user `92074e992399406c969d11eb97bff469`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:43:52.484925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:43:52.492075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1232/2419] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:43:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:44:01.136062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=30 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:02.478368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=49 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:10.159050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f11400-f17a-470b-ac51-1227ba1e4313 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:44:10.159654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f11400-f17a-470b-ac51-1227ba1e4313 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:44:10.159654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f11400-f17a-470b-ac51-1227ba1e4313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:44:10.177586 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-59f11400-f17a-470b-ac51-1227ba1e4313 None None] MFA Rules not processed for user `a47f45eaf4f444f8a86530b856e69473`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:44:10.179087 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-59f11400-f17a-470b-ac51-1227ba1e4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:44:10.240273 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1188/2420] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:44:18.482482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:44:18.483966 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:44:18.541303 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62708e8-64eb-402a-a2fe-847b850fbda0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:44:18.544784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:44:18.545444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:44:18.545722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:44:18.545996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:44:18.555048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:44:18.557160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:44:18.568080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1233/2421] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:44:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:44:20.233685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=25 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:28.563965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=26 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:29.386178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:44:29.386715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:44:29.386715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:44:29.404929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] MFA Rules not processed for user `880de431d70d4b35af04a043d7359661`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:44:29.406224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:44:29.465128 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1189/2422] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:44:39.458025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=25 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:57.185852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:44:57.195386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b2a9e-8b0b-4f5b-b60f-935012808941 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:44:57.199802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:44:57.200451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:44:57.200760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:44:57.201033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:44:57.202952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:44:57.217893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:44:57.219447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5432-cc2a-4882-a81f-6754cf13d00c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:44:57.231351 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1234/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:44:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:44:58.418784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:44:58.429487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6589d5-1b17-4ec3-9704-2c77c4492957 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:44:58.434045 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:44:58.434693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:44:58.434972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:44:58.435350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:44:58.437381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:44:58.451706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:44:58.453196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:44:58.464682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1190/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:44:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:02.440125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:02.440656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:02.440766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:02.465981 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:02.467249 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:02.649914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1235/2425] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:45:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:02.704503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:02.706031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:02.783760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255dfe5-7875-42bc-8983-a6fa87d6d36f service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:02.789780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:02.790431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:02.790718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:02.790995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:02.799569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:02.801205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:02.809290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1191/2426] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:45:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:03.413920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:03.424907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df5bbe-ad9c-46a0-a34d-2c3e835a2c63 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:03.431405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:03.432152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:03.432527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:03.432871 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:03.434887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:03.503258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:03.504910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:03.515963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1236/2427] 10.222.0.18 () {60 vars in 1396 bytes} [Thu Jul 21 05:45:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:10.137469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:10.139608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:10.218047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2654d24-6dc8-4528-878d-1b9fd8ba0566 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:10.221816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:10.222486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:10.222768 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:10.223043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:10.225093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:10.233847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:10.237689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:10.238690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:10.241493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:10.251453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1192/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:10.254936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd747a-6245-40c6-aafe-49ff016a00d3 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:10.260401 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effa626-80d1-4547-9fa8-9ca253244b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:10.261195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effa626-80d1-4547-9fa8-9ca253244b87 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:10.261537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effa626-80d1-4547-9fa8-9ca253244b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:10.261904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effa626-80d1-4547-9fa8-9ca253244b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:10.271745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effa626-80d1-4547-9fa8-9ca253244b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:10.273543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effa626-80d1-4547-9fa8-9ca253244b87 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:10.284933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1237/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:45:15.356193 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:15.358798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:15.444271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da5c04-a949-4ff4-9cad-9ff360b8a1f3 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:15.450461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:15.451116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:15.451409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:15.451687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:15.453727 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:15.465874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:15.467635 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:15.477930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1193/2430] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:20.279958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=65 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:20.498917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:20.499211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:20.499484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:20.517406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:20.518619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:20.527345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1238/2431] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:20.542278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:20.548114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:20.555109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec288-cd99-4b78-8ac1-16c13b7c21f4 service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:20.560960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:20.561618 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:20.561900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:20.562174 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:20.573567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:20.575375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:20.585349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1194/2432] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:45:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:30.512531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:30.581509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:34.411517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:34.422636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e5b24-6fdf-412c-a05d-01c722139f46 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:34.430337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:34.431250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:34.431531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:34.431957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:34.434113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:34.445765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:34.447430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbcd1a-606b-469b-986d-4fc6cad7ada4 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:34.456469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1239/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:35.449181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:35.450715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:35.466837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cbf1-a143-48a2-b5eb-ed9e60938e17 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:35.473568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:35.474238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:35.474516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:35.474797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:35.476958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:35.492282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:35.494086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:35.509571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1195/2434] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:37.172755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:37.173255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:37.173378 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:37.191140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:37.192459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:37.201265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1240/2435] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jul 21 05:45:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:37.214703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:37.226892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49611f48-0e2e-48eb-8d44-d1639d43ea18 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:37.232731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:37.233377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:37.233655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:37.233924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:37.242554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:37.244155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:37.253262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1196/2436] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:45:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:42.782543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:42.792112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1003c83-6a48-49bf-b967-c81f77792c07 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:42.795996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:42.796687 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:42.796965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:42.797229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:42.799329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:42.863887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:42.865364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:42.875159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1241/2437] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:47.250224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=12 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:47.603348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:47.605029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:47.623629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99539808-17a9-4c4e-8705-7175dee6085c service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:47.628769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:47.629894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:47.630406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:47.631036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] PATH_INFO: `/v3/users/a47f45eaf4f444f8a86530b856e69473` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:47.632780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47f45eaf4f444f8a86530b856e69473)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:47.635314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:47.702850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47f45eaf4f444f8a86530b856e69473'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:47.712869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47f45eaf4f444f8a86530b856e69473'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:47.713856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47f45eaf4f444f8a86530b856e69473'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:47.726815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47f45eaf4f444f8a86530b856e69473'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:47.727524 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-94f0f9c7-9f19-4242-9225-2981f702c11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47f45eaf4f444f8a86530b856e69473'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:47.758205 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1197/2438] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:45:47 2022] DELETE /identity/v3/users/a47f45eaf4f444f8a86530b856e69473 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:47.954230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:47.969926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e5cd-618c-4fbd-aa0d-e300e66480a6 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.030705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.031725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.031880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.032142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] PATH_INFO: `/v3/projects/baa0ca30598d473d8f03ef71fadbdeb8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.033427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa0ca30598d473d8f03ef71fadbdeb8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.035369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.087096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa0ca30598d473d8f03ef71fadbdeb8', 'request_id': 'req-46296ce0-d05d-4715-b6ad-9f007b1783b8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.093359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa0ca30598d473d8f03ef71fadbdeb8', 'request_id': 'req-46296ce0-d05d-4715-b6ad-9f007b1783b8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.102973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa0ca30598d473d8f03ef71fadbdeb8', 'request_id': 'req-46296ce0-d05d-4715-b6ad-9f007b1783b8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.116288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] The token cache is being invalidate because project baa0ca30598d473d8f03ef71fadbdeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:45:48.116619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.117278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-46296ce0-d05d-4715-b6ad-9f007b1783b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.118837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1242/2439] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:45:47 2022] DELETE /identity/v3/projects/baa0ca30598d473d8f03ef71fadbdeb8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:48.124112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.124384 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.124702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.147142 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:48.148374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:48.223308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1198/2440] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:45:48.231199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.231481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.231846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.240194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:48.256302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:48.257668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:48.270131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1243/2441] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:48.274730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.290395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86109-1e31-4c10-a94d-818677abbaf1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.294708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.296513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.296794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.297058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.297799 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:45:48.298100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.299743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.317087 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1199/2442] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:45:48.318272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.334846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62153c97-bd97-4299-b300-9854f716ca4b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.343235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.343919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.344193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.344512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.345222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.347137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.379595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1244/2443] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:45:48 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:45:48.380957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.392180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f18dff-a91f-440c-bc02-0d27a3c474c8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.455468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.456308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.456620 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.456967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.457777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.459878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.467003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:48.485420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1200/2444] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:45:48 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:45:48.489121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.502450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167cf66-2853-4a6d-a6a1-cc593fdf77f4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.507547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.508232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.508790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.508995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.510045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.511518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.533834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1245/2445] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:45:48.537782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.551081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da81a40-75e7-459d-9872-ab8e5e1c0767 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.566431 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92756f4a-b191-4458-90f5-8d2133ded16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.572621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92756f4a-b191-4458-90f5-8d2133ded16c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.573361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92756f4a-b191-4458-90f5-8d2133ded16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.573645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92756f4a-b191-4458-90f5-8d2133ded16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.574408 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92756f4a-b191-4458-90f5-8d2133ded16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.576117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92756f4a-b191-4458-90f5-8d2133ded16c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.586643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1201/2446] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:48.590873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.601141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344a220-de0c-4f76-9a25-5e84a196dc31 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.606004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.606933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.607208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.607479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] PATH_INFO: `/v3/projects/c3ffb24afb724962a17c8ba65ee26569/users/45ea3dcaa289463dad658f45d95a4ea0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.626946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ffb24afb724962a17c8ba65ee26569, user_id=45ea3dcaa289463dad658f45d95a4ea0, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.629965 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.652152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1246/2447] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:48 2022] PUT /identity/v3/projects/c3ffb24afb724962a17c8ba65ee26569/users/45ea3dcaa289463dad658f45d95a4ea0/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:48.663549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.663837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.664295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.685283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:48.686692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:48.755173 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1202/2448] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:48.765173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.767543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:48.782316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:48.784355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:48.796079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496473bc-8b96-4fd1-b034-ae5253d11f3f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.800663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.801550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.801830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.802102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] PATH_INFO: `/v3/users/880de431d70d4b35af04a043d7359661` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.803344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=880de431d70d4b35af04a043d7359661)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.805332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.843610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d46d9-84cb-4a00-b690-b96741faca08 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:48.847770 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:48.848420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:48.848727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:48.848997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:48.858678 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:48.859037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880de431d70d4b35af04a043d7359661'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.860590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:48.868167 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880de431d70d4b35af04a043d7359661'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.868983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880de431d70d4b35af04a043d7359661'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.872002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1247/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:48.886726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880de431d70d4b35af04a043d7359661'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.887782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b31f86e6-bf97-41dc-82a9-abf0737fc94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880de431d70d4b35af04a043d7359661'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:48.910087 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1203/2450] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:45:48 2022] DELETE /identity/v3/users/880de431d70d4b35af04a043d7359661 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:49.123595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.145667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c10ff-cfe9-40f1-b69a-a6c3dff98cd2 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.208758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.210455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.210455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.210455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] PATH_INFO: `/v3/projects/9e13120638fb4258854b78ed1d3d7cdc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.211402 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e13120638fb4258854b78ed1d3d7cdc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.213373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.274490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:49.277830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e13120638fb4258854b78ed1d3d7cdc', 'request_id': 'req-db712cda-5e26-4632-9960-7b6ab89e5b8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:49.285821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e13120638fb4258854b78ed1d3d7cdc', 'request_id': 'req-db712cda-5e26-4632-9960-7b6ab89e5b8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:49.297175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e13120638fb4258854b78ed1d3d7cdc', 'request_id': 'req-db712cda-5e26-4632-9960-7b6ab89e5b8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:49.309956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] The token cache is being invalidate because project 9e13120638fb4258854b78ed1d3d7cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:45:49.310357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:49.311259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-db712cda-5e26-4632-9960-7b6ab89e5b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:49.312997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1248/2451] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:45:49 2022] DELETE /identity/v3/projects/9e13120638fb4258854b78ed1d3d7cdc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:49.318079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.318828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.318828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.342823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:49.344046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:49.396044 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:49.421504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1204/2452] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:49.430266 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.430723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.430852 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.457997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:49.459219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:49.467058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1249/2453] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:49.471864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.482214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477971c2-1c70-4dcd-b550-929e1fd3c145 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.486946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.487600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.487878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.488147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.488967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:45:49.489272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.490876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.503623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1205/2454] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:45:49.508166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.517612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769fc80-90f5-4dba-a6e1-bfcc26b867b0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.522536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.523193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.523512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.523813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.524600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.526745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.560508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1250/2455] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:45:49 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:45:49.564984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.575747 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fb5a0-fa84-4483-a5e2-5f587ed6d42b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.649792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.650479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.650759 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.651025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.651738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.653756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.678508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1206/2456] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:45:49 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:45:49.681950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.693055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a57d84-4e62-496a-a71b-2bc6a58c2dd4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.697703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.698505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.698911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.699097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.699840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.701612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.716594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1251/2457] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:49.717888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.728441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47061-5e60-4e64-ac63-eb93ed77ef22 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.733295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f7091-c426-4f24-9280-0f22abd9ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.734065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f7091-c426-4f24-9280-0f22abd9ff2c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.734578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f7091-c426-4f24-9280-0f22abd9ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.734945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f7091-c426-4f24-9280-0f22abd9ff2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.735775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f7091-c426-4f24-9280-0f22abd9ff2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.737582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f7091-c426-4f24-9280-0f22abd9ff2c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.749224 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1207/2458] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:49.753695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.766535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a1de-810c-4fd5-b0ea-96a11faf4df7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:49.771378 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:49.773483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.773483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.773483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] PATH_INFO: `/v3/projects/4117e49c72ce4dceb56e8e38b381357b/users/61961cdb71c74c0087d6febe2596ffdf/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.792686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4117e49c72ce4dceb56e8e38b381357b, user_id=61961cdb71c74c0087d6febe2596ffdf, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:49.795448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:49.812039 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1252/2459] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:49 2022] PUT /identity/v3/projects/4117e49c72ce4dceb56e8e38b381357b/users/61961cdb71c74c0087d6febe2596ffdf/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:45:49.823081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:49.823456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:49.823795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:49.855119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] MFA Rules not processed for user `61961cdb71c74c0087d6febe2596ffdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:49.856470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:49.927676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1208/2460] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:49.932275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:49.999458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778431d1-86bb-4d48-8e8f-053bad27a7e9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.004209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.004921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.005198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.005469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.006162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.008099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.042839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1253/2461] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:45:49 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:45:50.047930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:50.063976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba8e6-a28f-4575-8ed6-6d0e0c744baf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.122312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:50.140358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.141284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.141660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.142023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.143046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.144934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.172703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1209/2462] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:45:50 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:45:50.176675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:50.188241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a516e4-e57a-4397-ada3-bfb07b23cae2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.192842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.193523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.193801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.194099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.195045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.196441 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.208771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1254/2463] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:50.212789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:50.222925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdea12-e762-4a71-b83d-12dc8fb2d1c0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.227856 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.228846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.229126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.229406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] PATH_INFO: `/v3/projects/f2ecc0c1a5714a7582015ac5d86699b6/users/f92d37ae62084e38b65743b903cbb9c2/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.248906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ecc0c1a5714a7582015ac5d86699b6, user_id=f92d37ae62084e38b65743b903cbb9c2, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.251649 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.268428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1210/2464] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:50 2022] PUT /identity/v3/projects/f2ecc0c1a5714a7582015ac5d86699b6/users/f92d37ae62084e38b65743b903cbb9c2/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:45:50.272908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:50.283826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd8653-840b-4c99-8b54-55183641d09e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.339145 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:50.358531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322c99c-d984-4ae2-9ca0-e2301bc1f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.359762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c99c-d984-4ae2-9ca0-e2301bc1f78b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.360137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c99c-d984-4ae2-9ca0-e2301bc1f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.360612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c99c-d984-4ae2-9ca0-e2301bc1f78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.361455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c99c-d984-4ae2-9ca0-e2301bc1f78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.363241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c99c-d984-4ae2-9ca0-e2301bc1f78b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.375735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1255/2465] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:45:50.380621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:50.391693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d2f4f-8f8f-49f7-a251-454d9c9a293d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.401012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.402705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.402705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.402705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] PATH_INFO: `/v3/projects/f2ecc0c1a5714a7582015ac5d86699b6/users/f92d37ae62084e38b65743b903cbb9c2/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.409668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ecc0c1a5714a7582015ac5d86699b6, user_id=f92d37ae62084e38b65743b903cbb9c2, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.409668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.428726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1211/2466] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:50 2022] PUT /identity/v3/projects/f2ecc0c1a5714a7582015ac5d86699b6/users/f92d37ae62084e38b65743b903cbb9c2/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:45:50.439519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.439910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.440302 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.470485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] MFA Rules not processed for user `f92d37ae62084e38b65743b903cbb9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:50.471716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:50.547472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1256/2467] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:50.559506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:50.561724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:50.659781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6048d-b36c-4715-b62b-b6374ebf2493 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:50.663604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2cb6e-8303-4923-8c40-b38cbb5b0f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:50.664356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2cb6e-8303-4923-8c40-b38cbb5b0f00 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:50.664745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2cb6e-8303-4923-8c40-b38cbb5b0f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:50.665088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2cb6e-8303-4923-8c40-b38cbb5b0f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:50.730984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2cb6e-8303-4923-8c40-b38cbb5b0f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:50.732766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2cb6e-8303-4923-8c40-b38cbb5b0f00 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:50.742637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1212/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:52.107972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:52.110665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:52.127667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef323c-48eb-4b2e-b0d0-05144c932433 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:52.132168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:52.133042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:52.133391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:52.133904 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:52.146055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:52.148712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:52.160798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1257/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:53.282199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286653e-e9df-49b5-8d6d-4567bb237f8e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:53.282696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286653e-e9df-49b5-8d6d-4567bb237f8e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:53.282791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286653e-e9df-49b5-8d6d-4567bb237f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:53.314731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1286653e-e9df-49b5-8d6d-4567bb237f8e None None] MFA Rules not processed for user `45ea3dcaa289463dad658f45d95a4ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:53.316101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1286653e-e9df-49b5-8d6d-4567bb237f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:53.373994 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:53.404119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1213/2470] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:53.423647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:53.425865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:53.553381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de00ba8-6a45-42cc-9710-139f57ce8bf3 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:53.564097 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:53.564825 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:53.565105 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:53.565382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:53.576616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:53.578243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:53.588522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1258/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:54.890559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:54.891038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:54.891134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:54.910037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] MFA Rules not processed for user `45ea3dcaa289463dad658f45d95a4ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:54.911361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:54.918839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1214/2472] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:55.307427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:55.309018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:55.371385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:55.390368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14818af6-86cb-4d38-8409-d8c98466619c service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:55.394427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:55.395170 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:55.395459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:55.395733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:55.398120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:55.412758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:55.414270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639cdea-91fe-4c97-96fd-a1abe5db20b8 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:55.423424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1259/2473] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:56.126381 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:56.206657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cab2-0863-4c9c-b34a-925ab71a3cb1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:56.213857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:56.214737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:56.215033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:56.215304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] PATH_INFO: `/v3/users/61961cdb71c74c0087d6febe2596ffdf` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:56.216648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61961cdb71c74c0087d6febe2596ffdf)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:56.219440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:56.282078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61961cdb71c74c0087d6febe2596ffdf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.291643 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61961cdb71c74c0087d6febe2596ffdf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.292290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61961cdb71c74c0087d6febe2596ffdf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.304823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61961cdb71c74c0087d6febe2596ffdf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.305690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61961cdb71c74c0087d6febe2596ffdf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.326421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1215/2474] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:45:56 2022] DELETE /identity/v3/users/61961cdb71c74c0087d6febe2596ffdf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:45:56.331533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:56.332061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:56.332419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:56.353480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:56.355362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:56.429210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1260/2475] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:45:56.439559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:56.441078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:56.500693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752d29-1eb4-43a2-b350-82347be0b224 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:56.504354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:56.505062 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:56.505347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:56.505622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:56.515544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:56.517061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:56.521605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:56.529548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1216/2476] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:56.830998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:56.833306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:56.858304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afffb2-345e-42b3-be3f-5f1075d3ca89 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:56.867925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:56.869821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:56.870382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:56.870894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] PATH_INFO: `/v3/projects/4117e49c72ce4dceb56e8e38b381357b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:56.880483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4117e49c72ce4dceb56e8e38b381357b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:56.883353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:56.966637 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4117e49c72ce4dceb56e8e38b381357b', 'request_id': 'req-3d759c51-4d00-4c45-b779-dd6decb48867'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.974215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4117e49c72ce4dceb56e8e38b381357b', 'request_id': 'req-3d759c51-4d00-4c45-b779-dd6decb48867'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:56.990297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4117e49c72ce4dceb56e8e38b381357b', 'request_id': 'req-3d759c51-4d00-4c45-b779-dd6decb48867'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.008144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] The token cache is being invalidate because project 4117e49c72ce4dceb56e8e38b381357b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:45:57.008454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.009163 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.011111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1261/2477] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:45:56 2022] DELETE /identity/v3/projects/4117e49c72ce4dceb56e8e38b381357b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:57.015216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:57.025695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cfa04-12f1-493e-82dc-f70a833193dc service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:57.091055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:57.091966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:57.092329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:57.092608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] PATH_INFO: `/v3/users/f92d37ae62084e38b65743b903cbb9c2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:57.093886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92d37ae62084e38b65743b903cbb9c2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:57.096004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:57.151924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92d37ae62084e38b65743b903cbb9c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.160671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92d37ae62084e38b65743b903cbb9c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.161932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92d37ae62084e38b65743b903cbb9c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.169386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92d37ae62084e38b65743b903cbb9c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.170129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8835d90e-75e9-44db-82b3-97493f4e103a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92d37ae62084e38b65743b903cbb9c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.190748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1217/2478] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:45:57 2022] DELETE /identity/v3/users/f92d37ae62084e38b65743b903cbb9c2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:57.498715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:57.500314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:57.521985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d759c51-4d00-4c45-b779-dd6decb48867 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:57.607544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:57.608458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:57.608764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:57.609037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] PATH_INFO: `/v3/projects/f2ecc0c1a5714a7582015ac5d86699b6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:57.610244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ecc0c1a5714a7582015ac5d86699b6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:57.612181 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:57.619178 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:57.672451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ecc0c1a5714a7582015ac5d86699b6', 'request_id': 'req-4d67d57a-b120-45b4-b05b-617fb88de260'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.678697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ecc0c1a5714a7582015ac5d86699b6', 'request_id': 'req-4d67d57a-b120-45b4-b05b-617fb88de260'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.688497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ecc0c1a5714a7582015ac5d86699b6', 'request_id': 'req-4d67d57a-b120-45b4-b05b-617fb88de260'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.707604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] The token cache is being invalidate because project f2ecc0c1a5714a7582015ac5d86699b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:45:57.708198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.708925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d67d57a-b120-45b4-b05b-617fb88de260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:57.710636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1262/2479] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:45:57 2022] DELETE /identity/v3/projects/f2ecc0c1a5714a7582015ac5d86699b6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:57.715840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:57.716129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:57.716404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:57.735264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:57.736464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:57.796019 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1218/2480] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:57.806098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:57.806900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:57.807415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:57.827224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:57.828426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:57.838719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1263/2481] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:57.844076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:57.854328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cdd3d-acf4-4661-ae9d-b336652c3d06 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:57.859430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:57.860114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:57.860396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:57.860718 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:57.861467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:45:57.861773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:57.863392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:57.876818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1219/2482] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:45:57.881296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:57.891490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c115432-5178-4557-bc9d-eba7d64e8b71 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:57.896790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:57.897463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:57.897748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:57.898026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:57.898771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:57.900757 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:57.931460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1264/2483] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:45:57 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:45:57.932732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:57.939811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:57.943455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2906dae-d7e8-4564-b65f-20dc6b416967 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.011025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.011582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.011850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.012121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.012976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.014889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.046891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1220/2484] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:45:57 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:45:58.048208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.062607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8be3-62ca-4336-bf4e-2d634f707d42 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.067347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.068031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.068310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.068613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.069355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.071543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.085577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1265/2485] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:58.089466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.100308 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f7b65-4a9d-4fb2-90eb-b72ed046faaf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.105071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5279ed-1451-482a-8a29-e34432b0986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.105854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5279ed-1451-482a-8a29-e34432b0986c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.105973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5279ed-1451-482a-8a29-e34432b0986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.106354 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5279ed-1451-482a-8a29-e34432b0986c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.107125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5279ed-1451-482a-8a29-e34432b0986c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.108983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5279ed-1451-482a-8a29-e34432b0986c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.120530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1221/2486] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:58.124264 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.135294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec821b-f5e5-4d1f-b3fa-43e4263cfa5d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.142575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.143531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.143870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.144204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] PATH_INFO: `/v3/projects/f1395aaecd2a4038838128adefdc1984/users/cbd51cf7a4d04cd4aeb328fa73dd41ee/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.161228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1395aaecd2a4038838128adefdc1984, user_id=cbd51cf7a4d04cd4aeb328fa73dd41ee, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.164082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.180595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1266/2487] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:58 2022] PUT /identity/v3/projects/f1395aaecd2a4038838128adefdc1984/users/cbd51cf7a4d04cd4aeb328fa73dd41ee/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:58.191425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.191425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.192026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.226325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] MFA Rules not processed for user `cbd51cf7a4d04cd4aeb328fa73dd41ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:58.228593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:58.300182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1222/2488] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:58.304851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.370336 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b31fc-0c60-49ed-b852-0bed526933e9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.385360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.386113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.386408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.386685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.387435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.389570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.431404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1267/2489] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:45:58 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:45:58.433099 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.453465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263b529-7e4e-40a7-9ab4-04d698e0fbac None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.519792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.520523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.520810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.521441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.522158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.524279 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.550356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1223/2490] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:45:58 2022] POST /identity/v3/users => generated 301 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:45:58.551675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.563317 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c4de8-5bc7-4152-a3aa-b297d033eea2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.568314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.569116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.569556 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.569684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.570390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.572204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.586927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1268/2491] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:58.587868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.593380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:58.600871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4f332-6ff4-4ac6-8fbf-f81859597c29 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.606222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.607155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.607441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.607713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] PATH_INFO: `/v3/projects/e38a70ec3c3a4ceca6dddb94b21a324f/users/246d39b711c04d0290ecdf3342907f57/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.623931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38a70ec3c3a4ceca6dddb94b21a324f, user_id=246d39b711c04d0290ecdf3342907f57, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.626501 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.641780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1224/2492] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:58 2022] PUT /identity/v3/projects/e38a70ec3c3a4ceca6dddb94b21a324f/users/246d39b711c04d0290ecdf3342907f57/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:45:58.645993 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.652798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:58.656897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f12bb1-527a-4ca9-8f70-5167a9d83c3c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.714686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9dc8f-18c6-436a-89bc-f0e3f06adbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.715389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9dc8f-18c6-436a-89bc-f0e3f06adbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.715751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9dc8f-18c6-436a-89bc-f0e3f06adbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.716058 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9dc8f-18c6-436a-89bc-f0e3f06adbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.716958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9dc8f-18c6-436a-89bc-f0e3f06adbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.718594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9dc8f-18c6-436a-89bc-f0e3f06adbf1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.728588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1269/2493] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:45:58.732985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.743804 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e3219-ecd0-427b-85e3-f0f0b5171575 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.748360 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.749296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.749573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.749859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] PATH_INFO: `/v3/projects/e38a70ec3c3a4ceca6dddb94b21a324f/users/246d39b711c04d0290ecdf3342907f57/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.751978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38a70ec3c3a4ceca6dddb94b21a324f, user_id=246d39b711c04d0290ecdf3342907f57, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.754654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.765544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1225/2494] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:45:58 2022] PUT /identity/v3/projects/e38a70ec3c3a4ceca6dddb94b21a324f/users/246d39b711c04d0290ecdf3342907f57/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:58.777560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562405-3d29-4bb4-915f-413b78219092 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.777880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562405-3d29-4bb4-915f-413b78219092 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.778168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08562405-3d29-4bb4-915f-413b78219092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.806265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-08562405-3d29-4bb4-915f-413b78219092 None None] MFA Rules not processed for user `246d39b711c04d0290ecdf3342907f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:58.807495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-08562405-3d29-4bb4-915f-413b78219092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:58.878740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1270/2495] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:58.889885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:58.891663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:58.951881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eb437-1bca-47ad-9622-36cc89f61df1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:58.956319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a8e02-100c-4195-9e5d-938bd0db94d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:58.956999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a8e02-100c-4195-9e5d-938bd0db94d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:58.957252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a8e02-100c-4195-9e5d-938bd0db94d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:58.957528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a8e02-100c-4195-9e5d-938bd0db94d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:58.966939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a8e02-100c-4195-9e5d-938bd0db94d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:58.968386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a8e02-100c-4195-9e5d-938bd0db94d3 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:58.978069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1226/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:59.111511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08562405-3d29-4bb4-915f-413b78219092 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:59.187845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08562405-3d29-4bb4-915f-413b78219092 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:59.193086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:59.193971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:59.194251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:59.194552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] PATH_INFO: `/v3/users/cbd51cf7a4d04cd4aeb328fa73dd41ee` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:59.195809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd51cf7a4d04cd4aeb328fa73dd41ee)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:59.197789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:59.230644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:59.249412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd51cf7a4d04cd4aeb328fa73dd41ee'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.261628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd51cf7a4d04cd4aeb328fa73dd41ee'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.262333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd51cf7a4d04cd4aeb328fa73dd41ee'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.272632 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd51cf7a4d04cd4aeb328fa73dd41ee'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.281244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd51cf7a4d04cd4aeb328fa73dd41ee'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.287271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1271/2497] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:45:59 2022] DELETE /identity/v3/users/cbd51cf7a4d04cd4aeb328fa73dd41ee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:59.291901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:59.292344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:59.292452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:59.310341 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:45:59.311541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:59.375868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1227/2498] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:45:59.389407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:59.391258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:59.459333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a3de4-da6d-4d3c-a9a3-2b028a967947 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:59.462937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:59.463595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:59.463946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:59.464148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:59.473119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:59.474591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:59.484666 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1272/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:45:59.790009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:59.791600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:45:59.804593 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74be692-ed3f-4e7e-9651-95365337fd51 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:59.809951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:59.810958 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:59.811211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:59.811479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] PATH_INFO: `/v3/projects/f1395aaecd2a4038838128adefdc1984` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:59.812783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1395aaecd2a4038838128adefdc1984)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:59.814699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:45:59.864389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1395aaecd2a4038838128adefdc1984', 'request_id': 'req-fa63f2f6-2b58-4f50-b436-69029e04b83c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.874580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1395aaecd2a4038838128adefdc1984', 'request_id': 'req-fa63f2f6-2b58-4f50-b436-69029e04b83c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.883211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1395aaecd2a4038838128adefdc1984', 'request_id': 'req-fa63f2f6-2b58-4f50-b436-69029e04b83c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.885665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:59.897675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] The token cache is being invalidate because project f1395aaecd2a4038838128adefdc1984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:45:59.898377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.899421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:45:59.901692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1228/2500] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:45:59 2022] DELETE /identity/v3/projects/f1395aaecd2a4038838128adefdc1984 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:45:59.905797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:45:59.918869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bedbf-81eb-4b0e-be0e-dd96996e2cd9 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:45:59.979905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:45:59.980853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:45:59.981244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:45:59.981606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] PATH_INFO: `/v3/users/246d39b711c04d0290ecdf3342907f57` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:45:59.982908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246d39b711c04d0290ecdf3342907f57)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:45:59.984880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.031681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246d39b711c04d0290ecdf3342907f57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.033561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:00.045101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246d39b711c04d0290ecdf3342907f57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.045753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246d39b711c04d0290ecdf3342907f57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.053869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246d39b711c04d0290ecdf3342907f57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.060668 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eaca163e-9f18-4fbf-a924-1f43b75022c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246d39b711c04d0290ecdf3342907f57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.066454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1273/2501] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:45:59 2022] DELETE /identity/v3/users/246d39b711c04d0290ecdf3342907f57 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:00.341481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.345322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:00.369223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63f2f6-2b58-4f50-b436-69029e04b83c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.431105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.432079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.432463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.432861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] PATH_INFO: `/v3/projects/e38a70ec3c3a4ceca6dddb94b21a324f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.434245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38a70ec3c3a4ceca6dddb94b21a324f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.436351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.488005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38a70ec3c3a4ceca6dddb94b21a324f', 'request_id': 'req-9519f56b-11fb-4c05-996b-89c29505e18e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.496314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38a70ec3c3a4ceca6dddb94b21a324f', 'request_id': 'req-9519f56b-11fb-4c05-996b-89c29505e18e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.502949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38a70ec3c3a4ceca6dddb94b21a324f', 'request_id': 'req-9519f56b-11fb-4c05-996b-89c29505e18e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.513909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] The token cache is being invalidate because project e38a70ec3c3a4ceca6dddb94b21a324f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:00.514436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.515250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9519f56b-11fb-4c05-996b-89c29505e18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:00.517114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1229/2502] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:00 2022] DELETE /identity/v3/projects/e38a70ec3c3a4ceca6dddb94b21a324f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:00.522597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.522882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.523153 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.541902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:00.543193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:00.608574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1274/2503] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:00.616721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.617091 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.617368 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.639259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:00.640465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:00.650071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1230/2504] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:00.654579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.664826 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d5b1-c34c-46b3-bdc3-f23634050288 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.670356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.671021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.671304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.671587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.672305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:00.672647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.674254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.686222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1275/2505] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:00.690613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.700282 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b379-c663-4a2a-b02f-10eaa5810bba None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.706230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.706891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.707169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.707440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.708125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.710056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.738636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1231/2506] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:00 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:00.743203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.753851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422dcd9-66bd-416c-b1bb-f68715a9221e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.811699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.812371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.812686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.812961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.813646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.815589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.837063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1276/2507] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:00 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:00.841387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.852028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e6f1b-d031-4298-8596-db5c216c1820 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.857638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.858297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.858575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.858844 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.859565 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.861186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.871683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1232/2508] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:00.875685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.886016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9f0a7-992d-4b9f-abd4-3739d8025c3e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.891106 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a4cb9-734e-4852-8a70-c00cbfe21625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.891752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4cb9-734e-4852-8a70-c00cbfe21625 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.892024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4cb9-734e-4852-8a70-c00cbfe21625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.892290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a4cb9-734e-4852-8a70-c00cbfe21625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.893070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a4cb9-734e-4852-8a70-c00cbfe21625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.894724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a4cb9-734e-4852-8a70-c00cbfe21625 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.905011 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1277/2509] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:00.909081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:00.918786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97525a-1f65-4e2f-9c67-04d085fb7681 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:00.923560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:00.924434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.924746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.925018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] PATH_INFO: `/v3/projects/c2357adedb98400b8f3463a387330dd7/users/e7bf6aae0c1e4787b4a5b7ad72c967e1/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.939809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2357adedb98400b8f3463a387330dd7, user_id=e7bf6aae0c1e4787b4a5b7ad72c967e1, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:00.942435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:00.957508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1233/2510] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:00 2022] PUT /identity/v3/projects/c2357adedb98400b8f3463a387330dd7/users/e7bf6aae0c1e4787b4a5b7ad72c967e1/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:00.968454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:00.969029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:00.969186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:00.997548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] MFA Rules not processed for user `e7bf6aae0c1e4787b4a5b7ad72c967e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:00.998767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:01.022921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:01.077442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1278/2511] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:01.082031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.102709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:01.146790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47053d8-fbfb-42d7-acb9-77572655b19f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.152057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.152748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.153029 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.153304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.153991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.155895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.189603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1234/2512] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:01 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:01.192969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.204462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981297-f4e3-4496-821d-fc35739d0f7e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.263054 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.263721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.263997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.264261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.264984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.267019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.291469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1279/2513] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:01 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:01.295534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.306480 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fada3-3f18-4b58-8884-b77ce964c8d9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.322204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.322924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.323209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.323477 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.324238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.326319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.338604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1235/2514] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:01.343778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.354867 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d155e8-af7f-4811-ae21-53134a45a889 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.360316 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.361253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.361525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.361790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] PATH_INFO: `/v3/projects/ad0e458b6dba46b785aaa72951eb38fd/users/72ae8cd581994baba6340b0aae480d97/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.377835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0e458b6dba46b785aaa72951eb38fd, user_id=72ae8cd581994baba6340b0aae480d97, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.380496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.395121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1280/2515] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:01 2022] PUT /identity/v3/projects/ad0e458b6dba46b785aaa72951eb38fd/users/72ae8cd581994baba6340b0aae480d97/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:01.399545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.409910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e322d-de54-45ba-8ae2-5d214af74f9a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.467146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f4a0d-6aba-4ac4-950a-58e6aefd6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.467749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f4a0d-6aba-4ac4-950a-58e6aefd6c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.468028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f4a0d-6aba-4ac4-950a-58e6aefd6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.468301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f4a0d-6aba-4ac4-950a-58e6aefd6c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.469068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f4a0d-6aba-4ac4-950a-58e6aefd6c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.470676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f4a0d-6aba-4ac4-950a-58e6aefd6c05 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.480784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1236/2516] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:01.485449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.496173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3b93e-8e38-424c-8745-e3221bfdd952 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.501018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.501898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.502171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.502437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] PATH_INFO: `/v3/projects/ad0e458b6dba46b785aaa72951eb38fd/users/72ae8cd581994baba6340b0aae480d97/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.504416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0e458b6dba46b785aaa72951eb38fd, user_id=72ae8cd581994baba6340b0aae480d97, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.507090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.517891 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1281/2517] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:01 2022] PUT /identity/v3/projects/ad0e458b6dba46b785aaa72951eb38fd/users/72ae8cd581994baba6340b0aae480d97/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:01.530272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.530566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.530847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.557737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] MFA Rules not processed for user `72ae8cd581994baba6340b0aae480d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:01.558950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:01.637890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1237/2518] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:01.650017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:01.651843 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:01.712590 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec5df-eb84-4806-a61e-1cb647e2ebb5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:01.716293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:01.716999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:01.717259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:01.717505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:01.747155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:01.775709 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:01.777185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:01.786091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1282/2519] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:04.334866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:04.336395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:04.352708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:04.419284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d9a6-4a2d-44e1-a364-54313f560f65 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:04.424967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:04.425631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:04.425914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:04.426186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:04.427988 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:04.440383 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:04.442013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:04.452247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1238/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:06.005183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:06.006710 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:06.018931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b0ae-ff5f-4313-a7b2-b018cdd84589 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:06.023627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34e63e-f06f-40cd-b65b-ae040d17457c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:06.024268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e63e-f06f-40cd-b65b-ae040d17457c service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:06.024578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e63e-f06f-40cd-b65b-ae040d17457c service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:06.024849 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e63e-f06f-40cd-b65b-ae040d17457c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:06.035846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e63e-f06f-40cd-b65b-ae040d17457c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:06.037368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e63e-f06f-40cd-b65b-ae040d17457c service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:06.048454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1283/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:10.985584 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:11.051048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9371d-4558-4f5a-a436-68ae79ec08ca service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:11.056567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:11.057453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:11.057732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:11.058006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] PATH_INFO: `/v3/users/e7bf6aae0c1e4787b4a5b7ad72c967e1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:11.059299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bf6aae0c1e4787b4a5b7ad72c967e1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:11.061291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:11.111047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bf6aae0c1e4787b4a5b7ad72c967e1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.119805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bf6aae0c1e4787b4a5b7ad72c967e1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.120411 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bf6aae0c1e4787b4a5b7ad72c967e1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.129028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bf6aae0c1e4787b4a5b7ad72c967e1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.129702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bf6aae0c1e4787b4a5b7ad72c967e1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.149379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1239/2522] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:10 2022] DELETE /identity/v3/users/e7bf6aae0c1e4787b4a5b7ad72c967e1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:11.154154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:11.154639 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:11.154725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:11.172253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:11.173659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:11.232625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1284/2523] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:11.242419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:11.243976 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:11.264989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:11.304901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5803d5-e298-4cd8-9d95-9523e8ef75db admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:11.308894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:11.309534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:11.309816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:11.310090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:11.319432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:11.320905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:11.330904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1240/2524] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:11.626454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:11.628408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:11.650157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff443b-b382-48d7-a68e-ef3e7762a7d9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:11.656065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:11.657043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:11.657330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:11.657605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] PATH_INFO: `/v3/projects/c2357adedb98400b8f3463a387330dd7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:11.658830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2357adedb98400b8f3463a387330dd7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:11.660786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:11.711008 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2357adedb98400b8f3463a387330dd7', 'request_id': 'req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.717073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2357adedb98400b8f3463a387330dd7', 'request_id': 'req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.725882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2357adedb98400b8f3463a387330dd7', 'request_id': 'req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.738471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] The token cache is being invalidate because project c2357adedb98400b8f3463a387330dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:11.738784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.739411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.741003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1285/2525] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:11 2022] DELETE /identity/v3/projects/c2357adedb98400b8f3463a387330dd7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:11.744999 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:11.754697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b29c4a-b9d2-4ccd-a296-a2ea8838a5ea service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:11.820667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:11.821576 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:11.821853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:11.822125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] PATH_INFO: `/v3/users/72ae8cd581994baba6340b0aae480d97` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:11.823316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ae8cd581994baba6340b0aae480d97)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:11.825284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:11.873122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ae8cd581994baba6340b0aae480d97'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.883513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ae8cd581994baba6340b0aae480d97'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.884196 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ae8cd581994baba6340b0aae480d97'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.891512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ae8cd581994baba6340b0aae480d97'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.892289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ba33acc-1f87-462a-a998-be27123f621a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ae8cd581994baba6340b0aae480d97'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:11.910614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1241/2526] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:11 2022] DELETE /identity/v3/users/72ae8cd581994baba6340b0aae480d97 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:12.195028 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.196560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:12.210360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ded12d-00ba-47d0-bc4f-25e4efb19fb6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.251464 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:12.271304 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.272098 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.272375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.272713 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] PATH_INFO: `/v3/projects/ad0e458b6dba46b785aaa72951eb38fd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.273875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0e458b6dba46b785aaa72951eb38fd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.276307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.321307 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0e458b6dba46b785aaa72951eb38fd', 'request_id': 'req-4de339d2-4897-476c-ba58-284e185da222'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:12.326738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0e458b6dba46b785aaa72951eb38fd', 'request_id': 'req-4de339d2-4897-476c-ba58-284e185da222'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:12.334495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0e458b6dba46b785aaa72951eb38fd', 'request_id': 'req-4de339d2-4897-476c-ba58-284e185da222'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:12.345984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] The token cache is being invalidate because project ad0e458b6dba46b785aaa72951eb38fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:12.346274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:12.347046 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4de339d2-4897-476c-ba58-284e185da222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:12.348793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1286/2527] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:12 2022] DELETE /identity/v3/projects/ad0e458b6dba46b785aaa72951eb38fd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:12.354983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.355447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.355589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.375038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:12.376259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:12.412631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:12.440037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1242/2528] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:12.449129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.449413 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.449701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.469083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:12.470314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:12.479732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1287/2529] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:12.484156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.498733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f01d2-42e3-4528-b733-e5c39898d0dc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.504190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.504863 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.505145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.505413 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.506140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:12.506446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.508046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.520601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1243/2530] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:12.525160 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.534795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3eb61-3799-439b-8490-c4d25cbb1d31 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.539951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.540659 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.540956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.541224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.541908 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.543813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.576203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1288/2531] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:12 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:12.580564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.591622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afdb53-1521-4270-aeed-da5fd5720b61 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.649624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.650700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.651133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.651548 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.652676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.655704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.682529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1244/2532] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:12 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:12.686984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.700086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3a17b-8642-4e9b-9e08-0edf20f004f9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.706748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.707451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.707786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.708067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.708980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.710691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.723297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1289/2533] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:12.727517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.738563 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc878e-0452-4898-96d6-6bd0e38aa6ac admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.744810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef93b-14bc-45b7-804a-3badbea328eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.745492 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef93b-14bc-45b7-804a-3badbea328eb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.745782 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef93b-14bc-45b7-804a-3badbea328eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.746056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef93b-14bc-45b7-804a-3badbea328eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.746821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef93b-14bc-45b7-804a-3badbea328eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.748440 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef93b-14bc-45b7-804a-3badbea328eb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.759792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1245/2534] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:12.764272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.775063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f437b2-41dd-4831-9b68-47c7ce61f059 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:12.779744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:12.780616 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.780898 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.781171 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] PATH_INFO: `/v3/projects/74b29dab0b18466697ca51b87d14ba26/users/4ff53436b3094584bf580d93d9216f24/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.796096 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b29dab0b18466697ca51b87d14ba26, user_id=4ff53436b3094584bf580d93d9216f24, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:12.798836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:12.813739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1290/2535] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:12 2022] PUT /identity/v3/projects/74b29dab0b18466697ca51b87d14ba26/users/4ff53436b3094584bf580d93d9216f24/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:12.827060 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:12.827349 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:12.828161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:12.856838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] MFA Rules not processed for user `4ff53436b3094584bf580d93d9216f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:12.858070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:12.930885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1246/2536] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:12.941602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:12.943497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:13.008947 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8fe2-a5a2-4d65-9c37-eee2a3a162a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:13.013247 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:13.013899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:13.014177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:13.014447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:13.023506 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:13.024992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:13.034398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1291/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:18.260509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:18.262095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:18.303456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:18.323562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f1cf-41da-4986-ac89-35e1ec93c054 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:18.327938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:18.328687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:18.329013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:18.329243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:18.331356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:18.396393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:18.397884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:18.409407 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1247/2538] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:21.668151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:21.671772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:21.682418 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:21.734794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:21.736325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:21.748824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596974-4205-4eff-af59-d6231f9d5d8c service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:21.753621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:21.754582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:21.754929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:21.755268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] PATH_INFO: `/v3/users/6bea3f54f3b2472480f16b6947598ab6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:21.756544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bea3f54f3b2472480f16b6947598ab6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:21.758556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:21.763702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750c477-5e97-41a0-af9c-471f0ac56d61 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:21.776404 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:21.777435 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:21.777721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:21.777989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:21.782387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:21.797456 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:21.799144 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:21.811103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1292/2539] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:21.825420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bea3f54f3b2472480f16b6947598ab6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:21.837668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bea3f54f3b2472480f16b6947598ab6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:21.838435 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bea3f54f3b2472480f16b6947598ab6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:21.860098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bea3f54f3b2472480f16b6947598ab6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:21.860874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b140e77-987f-4dc4-a526-70a402205a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bea3f54f3b2472480f16b6947598ab6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:21.883287 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1248/2540] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:21 2022] DELETE /identity/v3/users/6bea3f54f3b2472480f16b6947598ab6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:22.071495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.082943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa2f7-0a72-4337-bdb1-12848586ae0e service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.145845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.146634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.146914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.147183 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] PATH_INFO: `/v3/projects/b7ea110e9bb54809b765897bb6d69811` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.148346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ea110e9bb54809b765897bb6d69811)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.150359 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.198442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ea110e9bb54809b765897bb6d69811', 'request_id': 'req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:22.208036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ea110e9bb54809b765897bb6d69811', 'request_id': 'req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:22.216689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ea110e9bb54809b765897bb6d69811', 'request_id': 'req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:22.228350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] The token cache is being invalidate because project b7ea110e9bb54809b765897bb6d69811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:22.228676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:22.229319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4292cc7-7325-4f7b-86fe-4b8c8a67f8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:22.230915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1293/2541] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:22 2022] DELETE /identity/v3/projects/b7ea110e9bb54809b765897bb6d69811 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:22.236203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.236505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.236807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.256764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:22.257986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:22.310075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:22.322296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1249/2542] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:22.333481 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.334012 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.334261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.353924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:22.355147 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:22.364139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1294/2543] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:22.369078 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.384155 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206562ce-dd09-44c9-bde0-60c996923dfc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.391739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.392397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.392710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.392978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.393702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:22.394006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.396074 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.408298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1250/2544] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:22.412809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.422608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e58228-5dba-4da9-99ff-0db2ad397b8f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.428711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.429393 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.429673 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.429942 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.430635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.432597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.454952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:22.461425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1295/2545] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:22 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:22.465744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.476624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763b13-7ded-410d-b61e-dfc625a381a0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.538860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.539531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.539812 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.540081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.540793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.542745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.563622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1251/2546] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:22 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:22.567983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.579015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf377ef-41ac-4170-a8a8-5c1aa674ce09 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.584896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.585554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.585831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.586100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.586815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.588416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.599285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1296/2547] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:22.603356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.614023 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84520342-f41d-40df-8c7d-211c7accd549 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.619241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99eed8-1298-4754-bf09-92edc2646eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.619903 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99eed8-1298-4754-bf09-92edc2646eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.620188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99eed8-1298-4754-bf09-92edc2646eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.620461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99eed8-1298-4754-bf09-92edc2646eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.621206 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99eed8-1298-4754-bf09-92edc2646eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.622820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99eed8-1298-4754-bf09-92edc2646eb4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.632963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1252/2548] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:22.637207 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.648232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c4030-b113-4a5f-9b6a-03c424ea5b3d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.653569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.654454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.654749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.655017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] PATH_INFO: `/v3/projects/217e9a222f10403d897a57163132ae7a/users/d323c715d52e4d5da170b04e72978633/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.670354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=217e9a222f10403d897a57163132ae7a, user_id=d323c715d52e4d5da170b04e72978633, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.673057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.689235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1297/2549] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:22 2022] PUT /identity/v3/projects/217e9a222f10403d897a57163132ae7a/users/d323c715d52e4d5da170b04e72978633/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:22.699525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.699807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.700092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.727420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] MFA Rules not processed for user `d323c715d52e4d5da170b04e72978633`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:22.728690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:22.793702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1253/2550] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:22.805070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.807005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:22.882367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863381a5-b9ff-435e-8ba1-f4ce586a0fcc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:22.888294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e2de6-5387-4e34-9b42-4f4371c39715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:22.888968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e2de6-5387-4e34-9b42-4f4371c39715 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:22.889248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e2de6-5387-4e34-9b42-4f4371c39715 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:22.889575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e2de6-5387-4e34-9b42-4f4371c39715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:22.898665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e2de6-5387-4e34-9b42-4f4371c39715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:22.900187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e2de6-5387-4e34-9b42-4f4371c39715 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:22.909539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1298/2551] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:22.978814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:22.980238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:23.038075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:23.053134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeccd9-afe0-4599-a08e-8f14956f2645 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:23.059306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:23.060466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.061013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.061846 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] PATH_INFO: `/v3/users/4ff53436b3094584bf580d93d9216f24` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.063332 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff53436b3094584bf580d93d9216f24)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:23.065669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:23.123415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff53436b3094584bf580d93d9216f24'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.131393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff53436b3094584bf580d93d9216f24'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.131995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff53436b3094584bf580d93d9216f24'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.141251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff53436b3094584bf580d93d9216f24'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.141922 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff53436b3094584bf580d93d9216f24'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.163157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1254/2552] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:22 2022] DELETE /identity/v3/users/4ff53436b3094584bf580d93d9216f24 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:23.167879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.168186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.168496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.186004 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:23.187243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:23.257980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1299/2553] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:23.267757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:23.272053 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:23.333047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa8bbb-79db-4c75-9aac-b9dd8e3e99a6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:23.336690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3c35f-4c77-41d6-94a4-2fc4479d6d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:23.337342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3c35f-4c77-41d6-94a4-2fc4479d6d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.337619 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3c35f-4c77-41d6-94a4-2fc4479d6d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.337885 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3c35f-4c77-41d6-94a4-2fc4479d6d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.346833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3c35f-4c77-41d6-94a4-2fc4479d6d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:23.348257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3c35f-4c77-41d6-94a4-2fc4479d6d43 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:23.357697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1255/2554] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:23.640892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:23.642611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:23.655694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63641f01-73c2-4e6a-a6ec-85f1633c8f59 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:23.661353 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:23.662263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.662552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.662821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] PATH_INFO: `/v3/projects/74b29dab0b18466697ca51b87d14ba26` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.664119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b29dab0b18466697ca51b87d14ba26)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:23.666078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:23.716999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:23.720558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b29dab0b18466697ca51b87d14ba26', 'request_id': 'req-2636dd8d-93f2-435f-8624-51bca45ef4aa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.727428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b29dab0b18466697ca51b87d14ba26', 'request_id': 'req-2636dd8d-93f2-435f-8624-51bca45ef4aa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.735916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b29dab0b18466697ca51b87d14ba26', 'request_id': 'req-2636dd8d-93f2-435f-8624-51bca45ef4aa'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.747408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] The token cache is being invalidate because project 74b29dab0b18466697ca51b87d14ba26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:23.747696 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.748408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2636dd8d-93f2-435f-8624-51bca45ef4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:23.750074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1300/2555] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:23 2022] DELETE /identity/v3/projects/74b29dab0b18466697ca51b87d14ba26 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:23.813230 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.813881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.813881 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.831892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:23.833129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:23.898877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1256/2556] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:23.906921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.907208 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.907487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.929541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:23.930752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:23.938926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1301/2557] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:23.943307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:23.953134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977521-22df-4072-ac5e-f0afa0a9fe43 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:23.958049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:23.958697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.958979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.959246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.959972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:23.960274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:23.961920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:23.973709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1257/2558] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:23.977881 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:23.987507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314980a8-9b37-4492-b2c9-2962a2a50d6b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:23.993544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:23.994196 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:23.994480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:23.994751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:23.995434 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:23.997408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:24.025381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1302/2559] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:23 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:24.029577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:24.034798 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:24.041136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c3eae-d527-491c-9dcc-e461f74ee63f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:24.099033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:24.099708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:24.100008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:24.100286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:24.100989 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:24.102911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:24.133312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1258/2560] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:24 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:24.136882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:24.147751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301afb1b-310d-4fc8-a04c-11c920a5dc93 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:24.152777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:24.153445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:24.153727 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:24.154165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:24.154874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:24.156614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:24.170741 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1303/2561] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:24.171972 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:24.182860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1bd1a-dadb-42d9-870e-3757c7f532ed admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:24.188453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52527f-446f-4f81-bb24-3d53f1473b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:24.189180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52527f-446f-4f81-bb24-3d53f1473b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:24.189464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52527f-446f-4f81-bb24-3d53f1473b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:24.189742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52527f-446f-4f81-bb24-3d53f1473b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:24.190476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52527f-446f-4f81-bb24-3d53f1473b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:24.192093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52527f-446f-4f81-bb24-3d53f1473b14 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:24.206014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1259/2562] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:24.207285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:24.219685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2eccd-6a48-4d51-aaff-d13aef02e829 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:24.225677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:24.226522 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:24.226803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:24.227076 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] PATH_INFO: `/v3/projects/8142cacca09447afb32e490e35b98883/users/1fcccdd0be8942c1b4d7c3082078b506/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:24.243100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8142cacca09447afb32e490e35b98883, user_id=1fcccdd0be8942c1b4d7c3082078b506, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:24.246017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:24.260529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1304/2563] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:24 2022] PUT /identity/v3/projects/8142cacca09447afb32e490e35b98883/users/1fcccdd0be8942c1b4d7c3082078b506/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:24.271426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:24.271625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:24.271900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:24.301762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] MFA Rules not processed for user `1fcccdd0be8942c1b4d7c3082078b506`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:24.302971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:24.366896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1260/2564] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:24.378066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:24.380060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:24.443254 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f04d5-11c3-4bba-a916-e30eeecc9680 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:24.447200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5f934-e59d-4796-8daf-a7c2b475cea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:24.447861 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5f934-e59d-4796-8daf-a7c2b475cea8 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:24.448159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5f934-e59d-4796-8daf-a7c2b475cea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:24.448423 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5f934-e59d-4796-8daf-a7c2b475cea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:24.458027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5f934-e59d-4796-8daf-a7c2b475cea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:24.459390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5f934-e59d-4796-8daf-a7c2b475cea8 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:24.468539 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1305/2565] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:25.658461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:25.659731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:25.729758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbcecc-57d4-4c0e-ac0f-f9ee39912b9b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:25.734730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:25.735637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:25.735914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:25.736188 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] PATH_INFO: `/v3/users/d323c715d52e4d5da170b04e72978633` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:25.737412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d323c715d52e4d5da170b04e72978633)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:25.739350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:25.752057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:25.788329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd323c715d52e4d5da170b04e72978633'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:25.796974 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd323c715d52e4d5da170b04e72978633'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:25.797694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd323c715d52e4d5da170b04e72978633'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:25.810932 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd323c715d52e4d5da170b04e72978633'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:25.811694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3b9750-c8f8-444d-9db7-8530fa0f82ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd323c715d52e4d5da170b04e72978633'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:25.821173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:25.821663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:25.821753 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:25.830594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1261/2566] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:25 2022] DELETE /identity/v3/users/d323c715d52e4d5da170b04e72978633 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:25.834992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:25.835281 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:25.835582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:25.840166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] MFA Rules not processed for user `1fcccdd0be8942c1b4d7c3082078b506`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:25.841388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:25.854482 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:25.855681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:25.896795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1306/2567] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:25.915558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1262/2568] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:25.925499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:25.926952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:25.947483 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:25.987761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19e03-eed2-49d3-9d06-6e8af11bacce None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:25.991348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f654d-6a66-4635-8e6b-eaa0faef4a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:25.992005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f654d-6a66-4635-8e6b-eaa0faef4a5f service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:25.992289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f654d-6a66-4635-8e6b-eaa0faef4a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:25.992601 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f654d-6a66-4635-8e6b-eaa0faef4a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.002604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f654d-6a66-4635-8e6b-eaa0faef4a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.004044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f654d-6a66-4635-8e6b-eaa0faef4a5f service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.013946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1307/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:46:26.289995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.291422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:26.306372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6b193-3777-4093-b2e8-34133f5f1faa None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.312016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.313295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.314304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.314672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] PATH_INFO: `/v3/projects/217e9a222f10403d897a57163132ae7a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.316259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217e9a222f10403d897a57163132ae7a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.318276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.376361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217e9a222f10403d897a57163132ae7a', 'request_id': 'req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:26.387027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217e9a222f10403d897a57163132ae7a', 'request_id': 'req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:26.395911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217e9a222f10403d897a57163132ae7a', 'request_id': 'req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:26.410106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] The token cache is being invalidate because project 217e9a222f10403d897a57163132ae7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:26.410667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:26.412207 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c15bd1f-cab5-49dd-a802-1c4279c6ee33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:26.414208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1263/2570] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:26 2022] DELETE /identity/v3/projects/217e9a222f10403d897a57163132ae7a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:26.430226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.430226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.430226 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.439369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:26.440630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:26.507586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1308/2571] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:26.516494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.516870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.517075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.537451 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:26.538670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:26.547904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1264/2572] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:26.552499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.563694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacddae-ba17-4684-88cb-d7052ef27ffe None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.568763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.569627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.569916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.570265 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.570995 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:26.571324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.574235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.588884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1309/2573] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:26.593223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.605816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f008a-94be-48d8-ab9a-b35dba19c813 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.611680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.612526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.612875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.613149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.613928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.616083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.619758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:26.650857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1265/2574] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:26 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:26.655001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.667294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a06b2-6bf6-413d-9ae9-198d1f998f14 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.725806 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.726743 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.727022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.727296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.728006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.730073 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.750297 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1310/2575] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:26 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:26.753898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.765498 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b10f7a-a703-4cda-a611-c4a8bd648c3e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.771729 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.772410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.772728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.773017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.773815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.775904 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.786616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1266/2576] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:26.790669 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.801167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b2ca9-2ea7-42c7-8482-bdd26bd87aa9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.805956 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bc6d1-7639-4bd2-abc3-e723e1f6b453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.806644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bc6d1-7639-4bd2-abc3-e723e1f6b453 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.806921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bc6d1-7639-4bd2-abc3-e723e1f6b453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.807195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bc6d1-7639-4bd2-abc3-e723e1f6b453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.807917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bc6d1-7639-4bd2-abc3-e723e1f6b453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.809563 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bc6d1-7639-4bd2-abc3-e723e1f6b453 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.819762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1311/2577] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:26.823948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.834556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bccd5a-b7f1-4062-86a0-d14f83680673 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:26.839664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:26.840625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.840907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.841180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] PATH_INFO: `/v3/projects/7d30de8ac87049369f946f3d6eceff91/users/33115d373ee349bca52f9307229d4f42/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.857640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d30de8ac87049369f946f3d6eceff91, user_id=33115d373ee349bca52f9307229d4f42, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:26.860398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:26.875035 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1267/2578] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:26 2022] PUT /identity/v3/projects/7d30de8ac87049369f946f3d6eceff91/users/33115d373ee349bca52f9307229d4f42/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:26.880436 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e962-dc29-4db5-aac1-9bcce0ccc669 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:26.880961 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e962-dc29-4db5-aac1-9bcce0ccc669 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:26.881140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e962-dc29-4db5-aac1-9bcce0ccc669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:26.900151 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-03c5e962-dc29-4db5-aac1-9bcce0ccc669 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:26.901389 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-03c5e962-dc29-4db5-aac1-9bcce0ccc669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:26.922235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:26.967960 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1312/2579] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:26.978046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:26.979917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:27.037868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f556ac-efd2-4a4c-b1aa-5aae1cab3123 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:27.041899 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:27.042549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:27.042811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:27.043110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:27.052640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:27.054083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:27.063695 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1268/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:27.789744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:27.790129 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:27.790544 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:27.831968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] MFA Rules not processed for user `33115d373ee349bca52f9307229d4f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:27.834445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:27.964360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1313/2581] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:27.965549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:27.977218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d6d84-c9b7-46fc-ad58-0697124de7b2 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:27.982650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:27.983468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:27.983876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:27.984244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:27.985278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:27.987479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:28.029134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1269/2582] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:27 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:28.034255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:28.051674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2052d2e-9c37-4373-9c37-7560f5d293c1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:28.129114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:28.130107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:28.131587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:28.132111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:28.133218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:28.137477 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:28.166811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1314/2583] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:28 2022] POST /identity/v3/users => generated 308 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:28.168028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:28.178891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470bec-66a8-4f84-9894-e3dd5161aadc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:28.183775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:28.184562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:28.184915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:28.185257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:28.186076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:28.187779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:28.199057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1270/2584] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:28.203793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:28.214080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678df33-f849-47e4-8525-ca9d6dc27fc4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:28.218836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:28.219916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:28.220220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:28.220514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] PATH_INFO: `/v3/projects/8c891b695b494746b3c7b6c785f94681/users/5ba8422aed9d4c4d86401a2f3c941fba/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:28.235099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c891b695b494746b3c7b6c785f94681, user_id=5ba8422aed9d4c4d86401a2f3c941fba, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:28.237798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:28.251878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1315/2585] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:28 2022] PUT /identity/v3/projects/8c891b695b494746b3c7b6c785f94681/users/5ba8422aed9d4c4d86401a2f3c941fba/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:28.255906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:28.265895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eed89-c16a-4b54-b01a-fcf01d162036 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:28.323694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad3420-eebf-40fe-9c92-6901ad3846f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:28.324371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3420-eebf-40fe-9c92-6901ad3846f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:28.324653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3420-eebf-40fe-9c92-6901ad3846f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:28.324931 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3420-eebf-40fe-9c92-6901ad3846f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:28.325690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad3420-eebf-40fe-9c92-6901ad3846f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:28.327290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad3420-eebf-40fe-9c92-6901ad3846f2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:28.341633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1271/2586] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:28.342989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:28.353457 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6f01-7a6d-428a-ac3d-08cbaeabcd33 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:28.358686 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:28.359690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:28.360090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:28.360565 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] PATH_INFO: `/v3/projects/8c891b695b494746b3c7b6c785f94681/users/5ba8422aed9d4c4d86401a2f3c941fba/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:28.362677 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c891b695b494746b3c7b6c785f94681, user_id=5ba8422aed9d4c4d86401a2f3c941fba, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:28.365350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:28.376730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1316/2587] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:28 2022] PUT /identity/v3/projects/8c891b695b494746b3c7b6c785f94681/users/5ba8422aed9d4c4d86401a2f3c941fba/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:29.526024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:29.526513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:29.526609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:29.554335 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] MFA Rules not processed for user `5ba8422aed9d4c4d86401a2f3c941fba`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:29.555876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:29.560619 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:29.635090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1272/2588] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:31.099781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:31.115421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:31.168502 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28356a8-103f-42b2-98cc-ed9e6848dce4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:31.173970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:31.174834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:31.175111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:31.175479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] PATH_INFO: `/v3/users/33115d373ee349bca52f9307229d4f42` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:31.176758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33115d373ee349bca52f9307229d4f42)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:31.178679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:31.229887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33115d373ee349bca52f9307229d4f42'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.242189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33115d373ee349bca52f9307229d4f42'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.242911 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33115d373ee349bca52f9307229d4f42'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.254357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33115d373ee349bca52f9307229d4f42'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.261679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33115d373ee349bca52f9307229d4f42'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.267702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1317/2589] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:31 2022] DELETE /identity/v3/users/33115d373ee349bca52f9307229d4f42 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:31.458120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:31.483125 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9989b5-8d6b-4f47-9e18-254c469d2e9e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:31.544047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:31.544967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:31.545243 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:31.545510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] PATH_INFO: `/v3/projects/7d30de8ac87049369f946f3d6eceff91` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:31.546672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d30de8ac87049369f946f3d6eceff91)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:31.548765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:31.596564 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d30de8ac87049369f946f3d6eceff91', 'request_id': 'req-6aafadd9-3965-4df8-a19e-37da55b906af'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.605342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d30de8ac87049369f946f3d6eceff91', 'request_id': 'req-6aafadd9-3965-4df8-a19e-37da55b906af'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.611648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d30de8ac87049369f946f3d6eceff91', 'request_id': 'req-6aafadd9-3965-4df8-a19e-37da55b906af'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.624979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] The token cache is being invalidate because project 7d30de8ac87049369f946f3d6eceff91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:31.625269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.625954 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.627676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1273/2590] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:31 2022] DELETE /identity/v3/projects/7d30de8ac87049369f946f3d6eceff91 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:31.631683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:31.633288 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:31.647213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95568d1b-20ce-4b4a-b1fb-5dd3cbc323b0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:31.706017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:31.706906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:31.707190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:31.707465 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] PATH_INFO: `/v3/users/5ba8422aed9d4c4d86401a2f3c941fba` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:31.708798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba8422aed9d4c4d86401a2f3c941fba)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:31.710737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:31.746608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:31.763801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba8422aed9d4c4d86401a2f3c941fba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.776848 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba8422aed9d4c4d86401a2f3c941fba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.777591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba8422aed9d4c4d86401a2f3c941fba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.786295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba8422aed9d4c4d86401a2f3c941fba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.793978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dec9fd0c-aa9a-4fd3-8f30-59a19138d20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba8422aed9d4c4d86401a2f3c941fba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:31.800027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1318/2591] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:31 2022] DELETE /identity/v3/users/5ba8422aed9d4c4d86401a2f3c941fba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:31.975529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:31.977134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:31.990688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafadd9-3965-4df8-a19e-37da55b906af admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.022443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:32.052072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.052970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.053246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.053512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] PATH_INFO: `/v3/projects/8c891b695b494746b3c7b6c785f94681` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.054740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c891b695b494746b3c7b6c785f94681)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.056683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.103384 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c891b695b494746b3c7b6c785f94681', 'request_id': 'req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:32.111763 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c891b695b494746b3c7b6c785f94681', 'request_id': 'req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:32.118200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c891b695b494746b3c7b6c785f94681', 'request_id': 'req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:32.129253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] The token cache is being invalidate because project 8c891b695b494746b3c7b6c785f94681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:32.129592 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:32.130172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a7e37ef0-bfbd-444a-bb5a-30caa4dab6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:32.131738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1274/2592] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:31 2022] DELETE /identity/v3/projects/8c891b695b494746b3c7b6c785f94681 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:32.136914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.137417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.137417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.156975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:32.158217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:32.221357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1319/2593] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:32.230437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.230957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.231296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.253786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:32.255011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:32.263459 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1275/2594] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:32.267876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.278319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8e2a-0f56-4456-91b6-2a488993003f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.283155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.283844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.284102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.284372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.285148 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:32.285459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.287082 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.305180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1320/2595] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:32.306238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.316276 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb74bc7-da94-44ff-b90a-f0a5a283311e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.321319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.321690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.322039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.322305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.323042 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.325505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.357076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1276/2596] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:32.362873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.373840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662db983-3254-4869-9c62-a7b4f7e2c0f5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.446500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.447682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.448032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.448373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.449886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.451906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.480740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1321/2597] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:32.485774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.497028 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1de74-d20b-42f2-86d1-57370ad47671 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.501947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.502725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.503105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.503475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.504324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.506120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.517446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1277/2598] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:32.521879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.532222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a028-f00f-43b8-b4a0-565162ce392c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.537152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8efe9-4f05-4648-b175-35f9e5ea3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.537900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8efe9-4f05-4648-b175-35f9e5ea3ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.538252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8efe9-4f05-4648-b175-35f9e5ea3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.538591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8efe9-4f05-4648-b175-35f9e5ea3ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.539385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8efe9-4f05-4648-b175-35f9e5ea3ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.541032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8efe9-4f05-4648-b175-35f9e5ea3ad9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.551223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1322/2599] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:32.555471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.565781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304243d0-8018-48d1-ac98-d72f2c33213b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.571519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.572384 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.572719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.572990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] PATH_INFO: `/v3/projects/cecb4518c82f4e21bd6a20ad8cc13388/users/3b238af3de764bbca4b31ff10b57464d/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.591378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecb4518c82f4e21bd6a20ad8cc13388, user_id=3b238af3de764bbca4b31ff10b57464d, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.594058 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.608355 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1278/2600] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:32 2022] PUT /identity/v3/projects/cecb4518c82f4e21bd6a20ad8cc13388/users/3b238af3de764bbca4b31ff10b57464d/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:32.619244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.619574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.619854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.643573 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:32.647161 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] MFA Rules not processed for user `3b238af3de764bbca4b31ff10b57464d`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:32.649139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:32.714407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1323/2601] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:32.719738 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.785743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:32.789773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95426c12-a19d-402c-ad63-27efb0349624 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.799753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.801103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.801650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.802587 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.802926 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.805130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.832536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1279/2602] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:32.836374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.847194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1905a4-29ba-4efa-bc43-cba2374ca763 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.906059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.906801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.907084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.907442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.908242 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.910328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.931495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1324/2603] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:32 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:32.935632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.946795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb943357-d1c8-4d23-891b-244dbcb4302c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.952192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.952936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.953216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.953612 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:32.954315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:32.956015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:32.967835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1280/2604] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:32.971964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:32.982203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466952cd-141d-40bb-be46-053bc575feea admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:32.986937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299135d-46ea-4812-a988-eb9194d071fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:32.987819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299135d-46ea-4812-a988-eb9194d071fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:32.988093 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299135d-46ea-4812-a988-eb9194d071fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:32.988360 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299135d-46ea-4812-a988-eb9194d071fc admin admin] PATH_INFO: `/v3/projects/d9b1d598106f4b8dbe5bcd0f57f69fa4/users/3585fce1848a43ccbe4c52f759c2214f/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.004745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299135d-46ea-4812-a988-eb9194d071fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b1d598106f4b8dbe5bcd0f57f69fa4, user_id=3585fce1848a43ccbe4c52f759c2214f, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.007462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299135d-46ea-4812-a988-eb9194d071fc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.021681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1325/2605] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:32 2022] PUT /identity/v3/projects/d9b1d598106f4b8dbe5bcd0f57f69fa4/users/3585fce1848a43ccbe4c52f759c2214f/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:33.025743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:33.035898 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e355d32-9d5b-4d70-af9f-b2e263650acb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:33.104503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:33.105291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.105575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.105849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.105957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7582a2-35fd-4de5-9cd5-bb52f5edacef None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.106231 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7582a2-35fd-4de5-9cd5-bb52f5edacef None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.106530 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7582a2-35fd-4de5-9cd5-bb52f5edacef None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.106644 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.108375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1326/2606] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:46:33.108765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.114125 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.114405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.114680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.120685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1281/2607] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:33.125049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:33.134663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] MFA Rules not processed for user `22dd3a6e312242f5a0bfbcaa90359732`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:33.135165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb779-26a2-40b5-bf82-4e840924f78c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:33.135909 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:33.139733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e5565-0aaa-4a4f-92c5-8ae1fdd74071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:33.140702 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e5565-0aaa-4a4f-92c5-8ae1fdd74071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.141021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e5565-0aaa-4a4f-92c5-8ae1fdd74071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.141286 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e5565-0aaa-4a4f-92c5-8ae1fdd74071 admin admin] PATH_INFO: `/v3/projects/d9b1d598106f4b8dbe5bcd0f57f69fa4/users/3585fce1848a43ccbe4c52f759c2214f/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.144033 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e5565-0aaa-4a4f-92c5-8ae1fdd74071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b1d598106f4b8dbe5bcd0f57f69fa4, user_id=3585fce1848a43ccbe4c52f759c2214f, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.147052 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e5565-0aaa-4a4f-92c5-8ae1fdd74071 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.159141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1282/2608] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:33 2022] PUT /identity/v3/projects/d9b1d598106f4b8dbe5bcd0f57f69fa4/users/3585fce1848a43ccbe4c52f759c2214f/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:33.170075 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.170561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.170823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.198512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] MFA Rules not processed for user `3585fce1848a43ccbe4c52f759c2214f`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:33.199314 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1327/2609] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:33.200059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:33.217766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:33.220760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:33.238051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea6b4-1def-4a57-8c6c-e171a783c2e6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:33.255558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:33.287387 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1283/2610] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:33.298962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:33.300523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:33.302107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a94bf4-9cde-4d94-b7ed-005db911938a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:33.302842 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94bf4-9cde-4d94-b7ed-005db911938a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.303195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94bf4-9cde-4d94-b7ed-005db911938a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.303540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94bf4-9cde-4d94-b7ed-005db911938a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.316688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a94bf4-9cde-4d94-b7ed-005db911938a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.318175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a94bf4-9cde-4d94-b7ed-005db911938a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.326664 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1328/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:33.348226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:33.363825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165eb622-fb1b-4556-9c92-b96c53fee6ae None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:33.367902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0ce6-3d5d-4ff6-900c-6b7fadd0fad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:33.368594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0ce6-3d5d-4ff6-900c-6b7fadd0fad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.368874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0ce6-3d5d-4ff6-900c-6b7fadd0fad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.369149 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0ce6-3d5d-4ff6-900c-6b7fadd0fad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.378322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0ce6-3d5d-4ff6-900c-6b7fadd0fad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.379751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0ce6-3d5d-4ff6-900c-6b7fadd0fad7 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.390658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1284/2612] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:46:33.414224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7b4b-ce89-428c-9454-fd674033d827 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.414515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7b4b-ce89-428c-9454-fd674033d827 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.414794 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7b4b-ce89-428c-9454-fd674033d827 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.416212 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1329/2613] 10.222.0.18 () {54 vars in 921 bytes} [Thu Jul 21 05:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 05:46:33.421521 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.421810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.422084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.443285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] MFA Rules not processed for user `89e2cefbcf0449ff8fb8b695bba26dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:33.444500 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:33.469886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f7b4b-ce89-428c-9454-fd674033d827 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:33.480850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f7b4b-ce89-428c-9454-fd674033d827 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:33.484282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:33.485029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.485310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.485584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.514481 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1285/2614] 10.222.0.18 () {58 vars in 1018 bytes} [Thu Jul 21 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:33.527082 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:33.528461 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:33.539665 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03d0c-fc0c-4f2d-9c07-f00cc2214b6e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:33.542940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.543374 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83980a-5ed1-44be-b353-25fd6f66a9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:33.544010 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83980a-5ed1-44be-b353-25fd6f66a9fe service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:33.544321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83980a-5ed1-44be-b353-25fd6f66a9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:33.544615 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83980a-5ed1-44be-b353-25fd6f66a9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:33.544972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.554329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1330/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:33.554843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83980a-5ed1-44be-b353-25fd6f66a9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:33.556253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83980a-5ed1-44be-b353-25fd6f66a9fe service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:33.566882 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1286/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:46:40.485763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:40.563005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a6d4-fbb2-43d0-9b97-417659ad0268 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:40.570055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:40.571038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:40.571416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:40.571783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] PATH_INFO: `/v3/users/3b238af3de764bbca4b31ff10b57464d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:40.573127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b238af3de764bbca4b31ff10b57464d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:40.575299 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:40.649924 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b238af3de764bbca4b31ff10b57464d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:40.660499 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:40.662761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b238af3de764bbca4b31ff10b57464d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:40.663508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b238af3de764bbca4b31ff10b57464d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:40.674634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b238af3de764bbca4b31ff10b57464d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:40.681994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b238af3de764bbca4b31ff10b57464d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:40.688518 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1331/2617] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:40 2022] DELETE /identity/v3/users/3b238af3de764bbca4b31ff10b57464d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:40.693947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:40.694420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:40.694522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:40.714108 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:40.715802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:40.779046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1287/2618] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:40.788937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:40.790448 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:40.896015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97ae7e-a694-486d-afd4-302a4c9935e3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:40.900612 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:40.901782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:40.902358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:40.902799 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:40.918656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:40.920983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:40.942025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1332/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:41.220437 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:41.222490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:41.235645 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cfb3f-311f-4aee-a1c4-24de725dbca9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:41.240894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:41.241774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:41.242057 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:41.242330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] PATH_INFO: `/v3/projects/cecb4518c82f4e21bd6a20ad8cc13388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:41.243736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecb4518c82f4e21bd6a20ad8cc13388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:41.245663 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:41.293274 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecb4518c82f4e21bd6a20ad8cc13388', 'request_id': 'req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.301780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecb4518c82f4e21bd6a20ad8cc13388', 'request_id': 'req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.308506 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecb4518c82f4e21bd6a20ad8cc13388', 'request_id': 'req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.312683 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:41.322021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] The token cache is being invalidate because project cecb4518c82f4e21bd6a20ad8cc13388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:41.324526 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.325907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.328430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1288/2620] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:41 2022] DELETE /identity/v3/projects/cecb4518c82f4e21bd6a20ad8cc13388 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:41.332809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:41.342840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1da83-ba8a-4d0f-aac8-e70ba3324ea9 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:41.412988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:41.413935 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:41.414217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:41.414624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] PATH_INFO: `/v3/users/3585fce1848a43ccbe4c52f759c2214f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:41.415815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3585fce1848a43ccbe4c52f759c2214f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:41.417964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:41.468372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3585fce1848a43ccbe4c52f759c2214f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.481509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3585fce1848a43ccbe4c52f759c2214f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.482206 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3585fce1848a43ccbe4c52f759c2214f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.489833 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3585fce1848a43ccbe4c52f759c2214f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.497128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b5afc4cc-aa6f-435e-9652-ddb0b73e2061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3585fce1848a43ccbe4c52f759c2214f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.499346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:41.504582 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1333/2621] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:41 2022] DELETE /identity/v3/users/3585fce1848a43ccbe4c52f759c2214f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:41.785800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:41.787235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:41.800693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba0c7f-a739-4afe-b24d-7d2d32e23e07 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:41.861624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:41.862512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:41.862933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:41.863296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] PATH_INFO: `/v3/projects/d9b1d598106f4b8dbe5bcd0f57f69fa4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:41.864516 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b1d598106f4b8dbe5bcd0f57f69fa4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:41.866441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:41.914127 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b1d598106f4b8dbe5bcd0f57f69fa4', 'request_id': 'req-5e0af44d-8306-4170-ac97-1ff0f933f104'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.922348 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b1d598106f4b8dbe5bcd0f57f69fa4', 'request_id': 'req-5e0af44d-8306-4170-ac97-1ff0f933f104'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.928857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b1d598106f4b8dbe5bcd0f57f69fa4', 'request_id': 'req-5e0af44d-8306-4170-ac97-1ff0f933f104'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.939852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] The token cache is being invalidate because project d9b1d598106f4b8dbe5bcd0f57f69fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:41.940169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.940862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5e0af44d-8306-4170-ac97-1ff0f933f104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:41.942436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1289/2622] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:41 2022] DELETE /identity/v3/projects/d9b1d598106f4b8dbe5bcd0f57f69fa4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:41.947521 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:41.947811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:41.948084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:41.966536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:41.967736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:42.027177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1334/2623] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:42.036106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.036963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.036963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.058666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:42.059866 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:42.068347 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1290/2624] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:42.073233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.083450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77866e4d-587d-4a7d-909c-e939a0574a35 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.088220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.088906 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.089188 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.089450 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.090172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:42.090504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.092108 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.103811 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1335/2625] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:46:42.108190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.118004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d042d4-573d-457e-959f-530b05106f10 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.123139 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.123788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.124202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.124424 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.125250 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.127183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.155508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1291/2626] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:42.161051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.175179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02deb57-fd36-4a89-8620-06ee25ef6c92 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.235152 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.235827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.236110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.236381 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.237107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.239057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.259929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1336/2627] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:42.264073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.274847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940f6dc-1c76-4b38-a8c3-55217962897b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.280602 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.281265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.281545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.281815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.282534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.284130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.294959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1292/2628] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:42.299138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.309569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96776313-648b-4738-a18c-1394c9adc6a0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.315524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d542f-ad22-4907-bd9f-8c3e19df8bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.316215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d542f-ad22-4907-bd9f-8c3e19df8bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.316503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d542f-ad22-4907-bd9f-8c3e19df8bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.316759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d542f-ad22-4907-bd9f-8c3e19df8bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.317507 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d542f-ad22-4907-bd9f-8c3e19df8bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.319090 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d542f-ad22-4907-bd9f-8c3e19df8bd0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.329233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1337/2629] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:42.333847 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.344918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04caae-d39a-4711-8f71-e33a1696c705 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.349973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.350874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.351177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.351458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] PATH_INFO: `/v3/projects/7b709399978b47f3b346e58cb187e5dd/users/0c7fef4a33db48f6aeffcc240ff278ae/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.366098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b709399978b47f3b346e58cb187e5dd, user_id=0c7fef4a33db48f6aeffcc240ff278ae, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.368791 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.382568 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1293/2630] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:42 2022] PUT /identity/v3/projects/7b709399978b47f3b346e58cb187e5dd/users/0c7fef4a33db48f6aeffcc240ff278ae/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:42.393195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aaca2-f95f-46ee-ac92-b4ddcd8440d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.393484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aaca2-f95f-46ee-ac92-b4ddcd8440d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.394113 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aaca2-f95f-46ee-ac92-b4ddcd8440d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.423836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f64aaca2-f95f-46ee-ac92-b4ddcd8440d7 None None] MFA Rules not processed for user `0c7fef4a33db48f6aeffcc240ff278ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:42.425122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f64aaca2-f95f-46ee-ac92-b4ddcd8440d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:42.488348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:42.501784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1338/2631] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:42.503121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.516777 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:42.560592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.561107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.561598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.573850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179f1d9-481c-474a-9461-425887b801cf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.578410 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.579084 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.579494 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.579761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.580504 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.580618 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:42.581790 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:42.582512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.615377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1294/2632] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:42.619361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.645278 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1339/2633] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:42.695256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdd2f6-e8d1-4669-9830-e720d5d78779 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.699978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.700694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.700977 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.701252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.701551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.701966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.703440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:42.703973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.731978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1295/2634] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:42.733113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.742701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e494fa2-a2a7-461b-81b9-08756844864d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.747340 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.747993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.748277 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.748582 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.749302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.750982 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.761110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1296/2635] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:42.765059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.774734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ccd79-2165-4f31-ac53-6879a7fb1a45 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.777398 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35d411-8f46-4e44-ace7-231db1d6bfad None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.779260 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.780121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.780402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.780708 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] PATH_INFO: `/v3/projects/ef7c3691df6a42b781ec7b19e561a111/users/8c00e0b0773a4c5891c470231f9cecb7/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.796177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7c3691df6a42b781ec7b19e561a111, user_id=8c00e0b0773a4c5891c470231f9cecb7, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.798896 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.813476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1297/2636] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:42 2022] PUT /identity/v3/projects/ef7c3691df6a42b781ec7b19e561a111/users/8c00e0b0773a4c5891c470231f9cecb7/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:42.817418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.839062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fddf9-90b9-40ef-a209-197658dd1631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.839695 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fddf9-90b9-40ef-a209-197658dd1631 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.839973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fddf9-90b9-40ef-a209-197658dd1631 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.840243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fddf9-90b9-40ef-a209-197658dd1631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.869392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:42.882244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da509-6979-4c36-9225-5986d7ff0106 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.885681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:42.888114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.888897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.889178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.889447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.890184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.891876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.901057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fddf9-90b9-40ef-a209-197658dd1631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.902621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1298/2637] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:42.906100 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fddf9-90b9-40ef-a209-197658dd1631 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.906792 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:42.912205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1340/2638] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:46:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:46:42.917179 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09733-59eb-4afd-9658-84294e8c953b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:42.922165 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:42.923153 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.923331 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.923605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] PATH_INFO: `/v3/projects/ef7c3691df6a42b781ec7b19e561a111/users/8c00e0b0773a4c5891c470231f9cecb7/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.925658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7c3691df6a42b781ec7b19e561a111, user_id=8c00e0b0773a4c5891c470231f9cecb7, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:42.928300 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:42.940573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1299/2639] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:42 2022] PUT /identity/v3/projects/ef7c3691df6a42b781ec7b19e561a111/users/8c00e0b0773a4c5891c470231f9cecb7/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:42.950229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:42.950627 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:42.950781 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:42.977540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] MFA Rules not processed for user `8c00e0b0773a4c5891c470231f9cecb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:42.978832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.051789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1341/2640] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:43.063027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:43.064952 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.125202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdc161-17ca-47cb-a8cd-41a9cc8a9a33 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:43.129469 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690163d9-34fb-4e1b-8636-d1fbc5b318fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:43.130259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690163d9-34fb-4e1b-8636-d1fbc5b318fa service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.130642 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690163d9-34fb-4e1b-8636-d1fbc5b318fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.131011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690163d9-34fb-4e1b-8636-d1fbc5b318fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.141545 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690163d9-34fb-4e1b-8636-d1fbc5b318fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:43.142984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690163d9-34fb-4e1b-8636-d1fbc5b318fa service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:43.153436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1300/2641] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:43.219149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:43.284063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdc64a-a11c-4cb8-b54c-2ee8b7be50fc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:43.288829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:43.289779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.289989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.290259 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] PATH_INFO: `/v3/users/0c7fef4a33db48f6aeffcc240ff278ae` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.291493 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7fef4a33db48f6aeffcc240ff278ae)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:43.293472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:43.349798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7fef4a33db48f6aeffcc240ff278ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.362447 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7fef4a33db48f6aeffcc240ff278ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.363126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7fef4a33db48f6aeffcc240ff278ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.370850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7fef4a33db48f6aeffcc240ff278ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.372293 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:43.380736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c261ea78-a832-4c83-a0e7-4a18d351b604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7fef4a33db48f6aeffcc240ff278ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.388276 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1342/2642] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:43 2022] DELETE /identity/v3/users/0c7fef4a33db48f6aeffcc240ff278ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:43.392651 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.392930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.393222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.418068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:43.419329 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.439600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.440291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.440617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.460419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:43.461598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.481836 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1301/2643] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:43.492247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:43.493788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.515292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1343/2644] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jul 21 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:43.527814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:43.529300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.554933 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9567523-5957-40aa-98e6-3bc9a9864415 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:43.559278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c0e22-e2b8-486b-89cf-36c712ba1e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:43.560106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0e22-e2b8-486b-89cf-36c712ba1e3e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.560390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0e22-e2b8-486b-89cf-36c712ba1e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.560694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c0e22-e2b8-486b-89cf-36c712ba1e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.570187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c0e22-e2b8-486b-89cf-36c712ba1e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:43.571626 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c0e22-e2b8-486b-89cf-36c712ba1e3e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:43.581095 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1302/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:43.597661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e2a94-4980-4e4a-9e74-203cec6b4673 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:43.602736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:43.603392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.603690 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.604021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.613065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:43.614688 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:43.623330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1344/2646] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:46:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 05:46:43.830609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.831336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.831336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.855796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:43.857356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.865659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1303/2647] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:43.873482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:43.877681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:43.879860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:43.895237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8dbe0-eb7a-4237-9ea3-edb749ba9688 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:43.898155 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff764e-3df5-435e-948b-220331a7498e service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:43.902164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:43.902832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.903151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.903371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.903873 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:43.904853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:43.905256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:43.905652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] PATH_INFO: `/v3/projects/7b709399978b47f3b346e58cb187e5dd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:43.907124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b709399978b47f3b346e58cb187e5dd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:43.909500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:43.914857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:43.916539 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:43.922598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:43.928018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1304/2648] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:46:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:46:43.973116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b709399978b47f3b346e58cb187e5dd', 'request_id': 'req-7ae210f1-a8cd-4188-a478-d8319af56203'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.979013 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b709399978b47f3b346e58cb187e5dd', 'request_id': 'req-7ae210f1-a8cd-4188-a478-d8319af56203'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:43.988377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b709399978b47f3b346e58cb187e5dd', 'request_id': 'req-7ae210f1-a8cd-4188-a478-d8319af56203'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.006025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] The token cache is being invalidate because project 7b709399978b47f3b346e58cb187e5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:44.006344 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.007088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7ae210f1-a8cd-4188-a478-d8319af56203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.009200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1345/2649] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:43 2022] DELETE /identity/v3/projects/7b709399978b47f3b346e58cb187e5dd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:44.013284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:44.025445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded2cd7-e3fd-4338-81f1-6b995ae68f6a service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:44.101299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:44.102737 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.103118 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.103605 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] PATH_INFO: `/v3/users/8c00e0b0773a4c5891c470231f9cecb7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.105556 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c00e0b0773a4c5891c470231f9cecb7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:44.108559 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:44.176447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c00e0b0773a4c5891c470231f9cecb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.186292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c00e0b0773a4c5891c470231f9cecb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.187415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c00e0b0773a4c5891c470231f9cecb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.197733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c00e0b0773a4c5891c470231f9cecb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.198735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c00e0b0773a4c5891c470231f9cecb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.252769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1305/2650] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:44 2022] DELETE /identity/v3/users/8c00e0b0773a4c5891c470231f9cecb7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:44.353953 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.354591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.354870 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.368913 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:44.374885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:44.377562 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:44.455712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1346/2651] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jul 21 05:46:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:44.468304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:44.470017 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:44.546951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8203d1d-1989-477b-bd38-ef12b9892236 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:44.549542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:44.551085 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:44.552185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353811-0d59-4f30-a305-1925cd1fabe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:44.552905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353811-0d59-4f30-a305-1925cd1fabe6 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.553187 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353811-0d59-4f30-a305-1925cd1fabe6 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.553502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353811-0d59-4f30-a305-1925cd1fabe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.563237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353811-0d59-4f30-a305-1925cd1fabe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:44.565093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353811-0d59-4f30-a305-1925cd1fabe6 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:44.574438 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1306/2652] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:46:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:46:44.623920 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0f62f-c043-459c-8466-23e1b9a350d3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:44.629084 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:44.629994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.630280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.630557 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] PATH_INFO: `/v3/projects/ef7c3691df6a42b781ec7b19e561a111` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.631761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7c3691df6a42b781ec7b19e561a111)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:44.633764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:44.685694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7c3691df6a42b781ec7b19e561a111', 'request_id': 'req-ed2a7552-e1dd-41b3-b568-65e34815b854'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.689648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7c3691df6a42b781ec7b19e561a111', 'request_id': 'req-ed2a7552-e1dd-41b3-b568-65e34815b854'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.702552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7c3691df6a42b781ec7b19e561a111', 'request_id': 'req-ed2a7552-e1dd-41b3-b568-65e34815b854'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.714340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] The token cache is being invalidate because project ef7c3691df6a42b781ec7b19e561a111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:44.714591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.715324 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed2a7552-e1dd-41b3-b568-65e34815b854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:44.716907 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1347/2653] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:44 2022] DELETE /identity/v3/projects/ef7c3691df6a42b781ec7b19e561a111 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:44.721942 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.722234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.722514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.744653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:44.745781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:44.749995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:44.819267 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1307/2654] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:44.826943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.827244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.827517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.847864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:44.849094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:44.859605 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1348/2655] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:44.863906 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:44.874011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba315672-1d1e-440c-b31f-257c4c0c025c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:44.878960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:44.879820 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.880102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.880375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.881147 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:44.881460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:44.883367 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:44.896134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1308/2656] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:44.900289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:44.909902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedc287-f1c0-489a-b049-4a7f2dd6d488 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:44.914421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:44.915075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:44.915352 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:44.915622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:44.916319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:44.918463 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:44.948162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1349/2657] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:44 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:44.949330 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:44.959815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf43117-be29-479c-a616-a1c52cd06874 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.019797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.020499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.020779 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.021083 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.021825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.023826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.045158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1309/2658] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:44 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:45.049417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.060613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845b67b-697e-4e35-b1d4-d572b3844455 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.066805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.067505 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.067783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.068052 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.068813 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.070427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.081348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1350/2659] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:45.085390 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.096838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f81f6-aa92-4f80-b941-faca164ca099 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.101681 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d41a2-f602-4ee0-bffc-7625626ab1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.102405 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d41a2-f602-4ee0-bffc-7625626ab1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.102690 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d41a2-f602-4ee0-bffc-7625626ab1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.102966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d41a2-f602-4ee0-bffc-7625626ab1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.103707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d41a2-f602-4ee0-bffc-7625626ab1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.105357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d41a2-f602-4ee0-bffc-7625626ab1ea admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.115790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1310/2660] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:45.119888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.125409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:45.130658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdaee0-33dd-4f17-be41-15ff822f22b0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.137629 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.138734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.139095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.139442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] PATH_INFO: `/v3/projects/953a33101270485ea4e6bcb8afebd586/users/a50a2c521acc438eab74c4c2d081aa81/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.155439 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] RBAC: Authorizing `identity:create_grant(project_id=953a33101270485ea4e6bcb8afebd586, user_id=a50a2c521acc438eab74c4c2d081aa81, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.158272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.171846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1351/2661] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:45 2022] PUT /identity/v3/projects/953a33101270485ea4e6bcb8afebd586/users/a50a2c521acc438eab74c4c2d081aa81/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:45.182422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18405-526a-4e69-af87-d89366792162 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.182714 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18405-526a-4e69-af87-d89366792162 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.182992 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18405-526a-4e69-af87-d89366792162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.212235 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-30d18405-526a-4e69-af87-d89366792162 None None] MFA Rules not processed for user `a50a2c521acc438eab74c4c2d081aa81`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:45.213574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-30d18405-526a-4e69-af87-d89366792162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:45.283135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1311/2662] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:45.287702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.370045 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d3880-f041-4c4b-86fb-f5dc090e117f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.376368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.377080 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.377363 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.377635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.378342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.380250 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.426475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18405-526a-4e69-af87-d89366792162 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.426815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1352/2663] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:45 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:45.435021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:45.446497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18405-526a-4e69-af87-d89366792162 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.512270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.513110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.513378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.513674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.514475 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.517384 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.556748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1312/2664] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:45 2022] POST /identity/v3/users => generated 306 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:45.557408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.572229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7960613-9cf8-4cf2-a790-a8bbc04477c1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.578408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.579235 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.580091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.580560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.581298 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.582922 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.595921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1353/2665] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:45.600781 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.612072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e585e6-ad2d-497a-b14f-b9426a51eedb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.617950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.619015 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.619400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.619662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] PATH_INFO: `/v3/projects/56962cea8c5e4ffd82c20e1700e5221b/users/1a8f1fd7d83c4aa59e494fe35d2b09ce/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.640040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56962cea8c5e4ffd82c20e1700e5221b, user_id=1a8f1fd7d83c4aa59e494fe35d2b09ce, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.644092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.662406 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1313/2666] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:45 2022] PUT /identity/v3/projects/56962cea8c5e4ffd82c20e1700e5221b/users/1a8f1fd7d83c4aa59e494fe35d2b09ce/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:45.667571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.685596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5ee97-cf51-4896-a60a-71233d7b9a1c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.758604 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fb328-1ada-4bcb-b5bf-bcf433cfc159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.759374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fb328-1ada-4bcb-b5bf-bcf433cfc159 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.759657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fb328-1ada-4bcb-b5bf-bcf433cfc159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.759933 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fb328-1ada-4bcb-b5bf-bcf433cfc159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.760699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fb328-1ada-4bcb-b5bf-bcf433cfc159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.762322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fb328-1ada-4bcb-b5bf-bcf433cfc159 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.773216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1354/2667] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:45.777769 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.790026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104236-e957-46fb-9380-ad236d5d6e15 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.795265 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:45.796295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.796625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.796918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] PATH_INFO: `/v3/projects/56962cea8c5e4ffd82c20e1700e5221b/users/1a8f1fd7d83c4aa59e494fe35d2b09ce/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.799059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56962cea8c5e4ffd82c20e1700e5221b, user_id=1a8f1fd7d83c4aa59e494fe35d2b09ce, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:45.801726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:45.813220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1314/2668] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:45 2022] PUT /identity/v3/projects/56962cea8c5e4ffd82c20e1700e5221b/users/1a8f1fd7d83c4aa59e494fe35d2b09ce/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:45.824769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:45.825057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:45.825329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:45.853926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] MFA Rules not processed for user `1a8f1fd7d83c4aa59e494fe35d2b09ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:45.855199 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:45.893280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:45.924640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1355/2669] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:45.935661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:45.937537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:45.995895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5b8d1-05bc-4842-b4cc-3a4ae2e28972 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:45.999787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:46.000434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:46.000743 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:46.001021 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:46.010598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:46.012049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:46.022170 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1315/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:46.093238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:46.103622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a259d-5199-4ed3-88f2-7a1148f4130d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:46.107899 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630a08b-ca6b-4d63-bf20-5e4a4a7a9b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:46.108592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a08b-ca6b-4d63-bf20-5e4a4a7a9b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:46.108866 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a08b-ca6b-4d63-bf20-5e4a4a7a9b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:46.109167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a08b-ca6b-4d63-bf20-5e4a4a7a9b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:46.173022 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630a08b-ca6b-4d63-bf20-5e4a4a7a9b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:46.174473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630a08b-ca6b-4d63-bf20-5e4a4a7a9b4e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:46.183519 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1356/2671] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:46.707552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:46.709201 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:46.779686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b448bb-a6b4-47e8-a5ce-0c00871a85d8 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:46.784288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:46.785306 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:46.785474 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:46.785764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] PATH_INFO: `/v3/users/1fcccdd0be8942c1b4d7c3082078b506` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:46.786916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcccdd0be8942c1b4d7c3082078b506)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:46.788964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:46.790502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:46.849864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcccdd0be8942c1b4d7c3082078b506'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:46.859209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcccdd0be8942c1b4d7c3082078b506'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:46.860073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcccdd0be8942c1b4d7c3082078b506'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:46.867577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcccdd0be8942c1b4d7c3082078b506'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:46.868216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcccdd0be8942c1b4d7c3082078b506'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:46.888962 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1316/2672] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:46 2022] DELETE /identity/v3/users/1fcccdd0be8942c1b4d7c3082078b506 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:46.893882 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:46.894283 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:46.894581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:46.912910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:46.914286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:46.977823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1357/2673] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:46.988384 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:46.990289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:47.059822 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18cb83-f2ad-42c3-84dd-8b2ea8d6a9bb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.064269 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2905ca-472d-48da-876c-8e60395efb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.064959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2905ca-472d-48da-876c-8e60395efb31 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.065234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2905ca-472d-48da-876c-8e60395efb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.065503 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2905ca-472d-48da-876c-8e60395efb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.074735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2905ca-472d-48da-876c-8e60395efb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.076180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2905ca-472d-48da-876c-8e60395efb31 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.085677 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1317/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:47.381858 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.383443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:47.397057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622882b-8fb9-4088-9ef4-8ad2e6471c45 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.402739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.403736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.404309 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.404679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] PATH_INFO: `/v3/projects/8142cacca09447afb32e490e35b98883` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.409503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8142cacca09447afb32e490e35b98883)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.411663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.462498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8142cacca09447afb32e490e35b98883', 'request_id': 'req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:47.468071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8142cacca09447afb32e490e35b98883', 'request_id': 'req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:47.475821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8142cacca09447afb32e490e35b98883', 'request_id': 'req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:47.477876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:47.498279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] The token cache is being invalidate because project 8142cacca09447afb32e490e35b98883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:47.498834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:47.499824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8b7eb478-1e4c-48e1-9ecf-eb9bb47a5b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:47.501738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1358/2675] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:47 2022] DELETE /identity/v3/projects/8142cacca09447afb32e490e35b98883 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:47.507026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.507419 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.507761 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.532068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:47.533705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:47.608433 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1318/2676] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:47.616512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.616685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.616970 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.636470 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:47.637742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:47.648128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1359/2677] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:47.652760 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.665462 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220575db-4a5e-48a6-bb3c-55bed0645e2a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.670939 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.671621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.671961 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.672236 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.672997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:47.673304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.675297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.692071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1319/2678] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:46:47.696284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.705816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a301d7-6e96-4424-98d2-6829fec48876 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.711191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.711958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.712328 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.713305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.713472 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.715427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.754176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1360/2679] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:47 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:46:47.758138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.770964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7b49-89f6-497d-9959-641dcdecab30 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.780385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:47.852090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.852802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.853119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.853395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.854152 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.856077 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.887938 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1320/2680] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:47 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:47.889292 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.900267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183c369-db19-4dfe-a05b-70353f2e2520 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.905111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.905722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.906009 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.906337 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.907068 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.908711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.930640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1361/2681] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:47.931748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.942283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a2a2e-1c1a-4d80-9ca7-e1fbc941525a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.946921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2fb8d-9164-4c1e-a41b-fc26a1cdef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.947598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2fb8d-9164-4c1e-a41b-fc26a1cdef1b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.947884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2fb8d-9164-4c1e-a41b-fc26a1cdef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.948154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2fb8d-9164-4c1e-a41b-fc26a1cdef1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.948924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2fb8d-9164-4c1e-a41b-fc26a1cdef1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:47.950529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2fb8d-9164-4c1e-a41b-fc26a1cdef1b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:47.964530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1321/2682] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:47.966136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:47.977455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e38dcc-b501-4c56-ba90-83d927442fcb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:47.982368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:47.983345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:47.983692 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:47.984086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] PATH_INFO: `/v3/projects/12ed317250324a1a8459fe930b1264ac/users/15732421836841f494ecc67fa75cf4bf/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:47.999333 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ed317250324a1a8459fe930b1264ac, user_id=15732421836841f494ecc67fa75cf4bf, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:48.002135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:48.016588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1362/2683] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:47 2022] PUT /identity/v3/projects/12ed317250324a1a8459fe930b1264ac/users/15732421836841f494ecc67fa75cf4bf/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:48.022253 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452c22-391b-4b25-b051-2566d3f6e57c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:48.022719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452c22-391b-4b25-b051-2566d3f6e57c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:48.022865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452c22-391b-4b25-b051-2566d3f6e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:48.042263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-08452c22-391b-4b25-b051-2566d3f6e57c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:48.043653 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08452c22-391b-4b25-b051-2566d3f6e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:48.102689 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1322/2684] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:48.112331 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:48.114213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:48.175584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c7de-e3d0-4ba6-9aae-2ca8498807c4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:48.180373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:48.181065 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:48.181346 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:48.181667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:48.192433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:48.193932 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:48.204198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1363/2685] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:48.256140 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64843c-4a08-4571-a48a-aa350fc15fa5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:48.256428 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64843c-4a08-4571-a48a-aa350fc15fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:48.256733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64843c-4a08-4571-a48a-aa350fc15fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:48.276956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fc64843c-4a08-4571-a48a-aa350fc15fa5 None None] MFA Rules not processed for user `45ea3dcaa289463dad658f45d95a4ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:48.278184 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fc64843c-4a08-4571-a48a-aa350fc15fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:48.341625 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1323/2686] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:50.405209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:50.406804 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:50.428823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee24a2-d36a-43dc-8f92-2d774f4ced33 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:50.437954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:50.439494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:50.440954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:50.441357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] PATH_INFO: `/v3/users/a50a2c521acc438eab74c4c2d081aa81` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:50.442892 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50a2c521acc438eab74c4c2d081aa81)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:50.445740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:50.524356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50a2c521acc438eab74c4c2d081aa81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:50.538684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50a2c521acc438eab74c4c2d081aa81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:50.539895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50a2c521acc438eab74c4c2d081aa81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:50.549532 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50a2c521acc438eab74c4c2d081aa81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:50.560289 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50a2c521acc438eab74c4c2d081aa81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:50.567408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1364/2687] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:50 2022] DELETE /identity/v3/users/a50a2c521acc438eab74c4c2d081aa81 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:50.571997 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:50.572571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:50.572571 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:50.590423 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:50.591873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:50.623884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:50.672585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1324/2688] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:50.691542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:50.694285 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:50.711083 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:50.785783 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9924c0-4b0d-4a25-a131-c70516bbe254 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:50.791306 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:50.791832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:50.792118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:50.792437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:50.808095 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:50.810516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:50.823837 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1365/2689] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:51.769214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:51.771794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:51.794953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33415ec8-f7d8-411a-b700-0fc043583bbf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:51.804825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:51.806819 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:51.807376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:51.807878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] PATH_INFO: `/v3/projects/953a33101270485ea4e6bcb8afebd586` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:51.816713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953a33101270485ea4e6bcb8afebd586)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:51.819930 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:51.913371 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953a33101270485ea4e6bcb8afebd586', 'request_id': 'req-d685fb89-7734-43a4-bd3b-603365ac2369'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:51.949039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953a33101270485ea4e6bcb8afebd586', 'request_id': 'req-d685fb89-7734-43a4-bd3b-603365ac2369'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:51.959320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953a33101270485ea4e6bcb8afebd586', 'request_id': 'req-d685fb89-7734-43a4-bd3b-603365ac2369'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:51.999202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] The token cache is being invalidate because project 953a33101270485ea4e6bcb8afebd586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:51.999837 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.000796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.003288 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1325/2690] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:51 2022] DELETE /identity/v3/projects/953a33101270485ea4e6bcb8afebd586 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:52.008771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:52.023474 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c300d00-0337-40e8-b3fe-ee99ebd91a85 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:52.126581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:52.127486 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:52.127767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:52.128041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] PATH_INFO: `/v3/users/1a8f1fd7d83c4aa59e494fe35d2b09ce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:52.129587 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8f1fd7d83c4aa59e494fe35d2b09ce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:52.131537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:52.212964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8f1fd7d83c4aa59e494fe35d2b09ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.238630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8f1fd7d83c4aa59e494fe35d2b09ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.239903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8f1fd7d83c4aa59e494fe35d2b09ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.259610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8f1fd7d83c4aa59e494fe35d2b09ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.270596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8f1fd7d83c4aa59e494fe35d2b09ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:52.278921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1366/2691] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:52 2022] DELETE /identity/v3/users/1a8f1fd7d83c4aa59e494fe35d2b09ce => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:52.307490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:52.310956 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:52.478736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685fb89-7734-43a4-bd3b-603365ac2369 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:52.614527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:52.664164 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:52.664907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:52.665190 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:52.665464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:52.667297 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:52.680758 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:52.682377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98606168-025d-4a5d-ad21-f2c7cda785d6 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:52.705628 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1326/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:53.291157 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.293244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:53.356702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:53.417624 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99cf9e-5bb4-4237-b3f3-a0b05fcd0e2e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:53.430219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:53.431057 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.431511 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.431784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] PATH_INFO: `/v3/projects/56962cea8c5e4ffd82c20e1700e5221b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.433036 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56962cea8c5e4ffd82c20e1700e5221b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:53.435176 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:53.522121 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56962cea8c5e4ffd82c20e1700e5221b', 'request_id': 'req-ab648016-4f6b-4fce-8150-4799fe2e9f76'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:53.534244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56962cea8c5e4ffd82c20e1700e5221b', 'request_id': 'req-ab648016-4f6b-4fce-8150-4799fe2e9f76'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:53.559877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56962cea8c5e4ffd82c20e1700e5221b', 'request_id': 'req-ab648016-4f6b-4fce-8150-4799fe2e9f76'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:53.584626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] The token cache is being invalidate because project 56962cea8c5e4ffd82c20e1700e5221b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:53.585131 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:53.585865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ab648016-4f6b-4fce-8150-4799fe2e9f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:53.587717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1367/2693] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:53 2022] DELETE /identity/v3/projects/56962cea8c5e4ffd82c20e1700e5221b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:53.593392 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbf2e1-b931-42ef-85b1-1b507adc7b82 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.594211 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbf2e1-b931-42ef-85b1-1b507adc7b82 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.594674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbf2e1-b931-42ef-85b1-1b507adc7b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.614701 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-70fbf2e1-b931-42ef-85b1-1b507adc7b82 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:53.615920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70fbf2e1-b931-42ef-85b1-1b507adc7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:53.664246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.664647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.665047 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.702736 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] MFA Rules not processed for user `15732421836841f494ecc67fa75cf4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:53.704272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:53.725089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1327/2694] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:53.733012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.733298 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.733575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.759828 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:53.762129 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:53.773600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1328/2695] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:53.778552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.789106 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e518a05-595e-4af6-a340-e14eec1eae9e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:53.789310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1368/2696] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:46:53.794025 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.795429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:53.796963 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:53.797655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.797940 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.798223 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.798966 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:46:53.799307 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:53.800923 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:53.809210 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709ca1e-406e-4746-aefd-273f5905cc29 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:53.813949 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:53.814744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1329/2697] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 05:46:53.814851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.814954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.815137 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.815829 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:53.817985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:53.821773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.833418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969ee71-9e3e-4ecd-8715-041bad74b99f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:53.838855 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:53.839537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.839874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.840117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.840871 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:53.842774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:53.847676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1369/2698] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:53.854934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.875376 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1330/2699] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:53.880455 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.895417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:53.940766 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27496e-60a5-4971-b70c-ac03649c7bdb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:53.953009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007837c-d3e4-490c-9737-6de9a0c591dd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:53.957630 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:53.958523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:53.958633 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:53.958851 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:53.959574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:53.961578 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:53.984046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1331/2700] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:53.988048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:53.998884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0507-3884-478b-9be6-ba92a8684ac3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.003809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.004604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.004964 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.005303 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.006110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.006508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.007403 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.007697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.007973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.008124 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.008772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.010706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.019555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1332/2701] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:54.023537 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.034884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1850a1f-5b39-436a-bb0c-6257ee5a71b4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.035758 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1370/2702] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:53 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:54.039802 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.041487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.042178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.042479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.042730 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.043464 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.045122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.050547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d63f-05ff-469a-b2e6-849ba78669aa admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.055426 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.056102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.056427 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.056745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.057721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.059220 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.062705 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1333/2703] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:54.064181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.070421 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1371/2704] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:54.074614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.075352 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b4baa-71bc-4c95-8f2b-a80e91074860 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.080660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23b62-7d4a-43bb-acc6-c87f7c810017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.083114 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23b62-7d4a-43bb-acc6-c87f7c810017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.083527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23b62-7d4a-43bb-acc6-c87f7c810017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.083814 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23b62-7d4a-43bb-acc6-c87f7c810017 admin admin] PATH_INFO: `/v3/projects/6e388f88a7ec4b99baf06aa7fa12e7a5/users/9dcf902b69df4d8582d6279a5f97300c/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.085893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77460e0c-a79a-4c3b-80ec-4058e4ee4d3d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.086562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:54.104132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.105168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.105580 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.105977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] PATH_INFO: `/v3/projects/83d9e3ec0a6f446ea999b125907b4ec6/users/4d5f09dcac9a4cf696f91a804d4628e0/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.112301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23b62-7d4a-43bb-acc6-c87f7c810017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e388f88a7ec4b99baf06aa7fa12e7a5, user_id=9dcf902b69df4d8582d6279a5f97300c, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.115177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23b62-7d4a-43bb-acc6-c87f7c810017 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.126087 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d9e3ec0a6f446ea999b125907b4ec6, user_id=4d5f09dcac9a4cf696f91a804d4628e0, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.129059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.148987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1334/2705] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:54 2022] PUT /identity/v3/projects/6e388f88a7ec4b99baf06aa7fa12e7a5/users/9dcf902b69df4d8582d6279a5f97300c/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:54.151569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.151868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.152182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.158484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1372/2706] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:54 2022] PUT /identity/v3/projects/83d9e3ec0a6f446ea999b125907b4ec6/users/4d5f09dcac9a4cf696f91a804d4628e0/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:46:54.159689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.200377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] MFA Rules not processed for user `9dcf902b69df4d8582d6279a5f97300c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:54.202296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:54.245295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc25f8e-1a91-488b-afce-3996a2606130 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.250773 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.251469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.251747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.252024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.252877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.254631 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.265726 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1373/2707] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:54.271079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.281735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1adc3-94b6-43be-883d-e685395b074d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.286693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.287595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.287850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.288119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] PATH_INFO: `/v3/projects/83d9e3ec0a6f446ea999b125907b4ec6/users/4d5f09dcac9a4cf696f91a804d4628e0/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.290370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d9e3ec0a6f446ea999b125907b4ec6, user_id=4d5f09dcac9a4cf696f91a804d4628e0, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.293112 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.302597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1335/2708] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:54.308606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1374/2709] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:54 2022] PUT /identity/v3/projects/83d9e3ec0a6f446ea999b125907b4ec6/users/4d5f09dcac9a4cf696f91a804d4628e0/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:54.312534 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.330905 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3c9e-e704-4458-af7c-9b621a14a0d8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.415238 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.417217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.417555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.417826 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.418533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.420797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.455523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1336/2710] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:46:54 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:54.459684 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.470831 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff613a-e8b9-4055-b08e-9c5ad3e13e6b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.483345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:54.553141 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.554175 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.554644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.555102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.556059 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.559548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.592643 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1375/2711] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:46:54 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:46:54.596694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.608219 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbc187-5be9-4fde-bd7b-409e4b112fdd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.614519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.615218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.615486 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.615759 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.616573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.618315 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.632143 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1337/2712] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:46:54.636872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.648031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033884b7-9919-4f30-a7ab-436cba7037c2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.652914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.654364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.654364 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.654603 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] PATH_INFO: `/v3/projects/0ae3de17fd4b4ad69b04a08d720cf1b2/users/53c44b2e562a4051a5b3f7e0d96af65c/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.677136 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3de17fd4b4ad69b04a08d720cf1b2, user_id=53c44b2e562a4051a5b3f7e0d96af65c, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.680120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.710256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1376/2713] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:54 2022] PUT /identity/v3/projects/0ae3de17fd4b4ad69b04a08d720cf1b2/users/53c44b2e562a4051a5b3f7e0d96af65c/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:54.714418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.727947 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f6aca-3ec2-4adf-9dfa-55386a09ecdd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.793386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:54.816656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf64bc0-11f0-4328-bb67-2e1cba813d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.817650 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf64bc0-11f0-4328-bb67-2e1cba813d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.818177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf64bc0-11f0-4328-bb67-2e1cba813d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.818466 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf64bc0-11f0-4328-bb67-2e1cba813d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.819484 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf64bc0-11f0-4328-bb67-2e1cba813d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.821911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf64bc0-11f0-4328-bb67-2e1cba813d14 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.832740 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1338/2714] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:46:54.836815 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:54.848431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e90c52-1a49-4c74-8c48-ac586732c39b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:54.853140 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:54.854041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.854320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.854594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] PATH_INFO: `/v3/projects/0ae3de17fd4b4ad69b04a08d720cf1b2/users/53c44b2e562a4051a5b3f7e0d96af65c/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.856597 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae3de17fd4b4ad69b04a08d720cf1b2, user_id=53c44b2e562a4051a5b3f7e0d96af65c, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:54.859586 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:54.870817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1377/2715] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:46:54 2022] PUT /identity/v3/projects/0ae3de17fd4b4ad69b04a08d720cf1b2/users/53c44b2e562a4051a5b3f7e0d96af65c/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:54.941983 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:54.942344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:54.942554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:54.974370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] MFA Rules not processed for user `53c44b2e562a4051a5b3f7e0d96af65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:54.975750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:55.053567 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1339/2716] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:55.065119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:55.066835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:55.130701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368d93b-1026-483d-9849-a5903c34be27 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:55.135469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:55.136159 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:55.136445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:55.136975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:55.148874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:55.150340 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:55.161547 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1378/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:55.272629 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:55.290351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74199b3-7094-402c-a0c3-43ceced402ed None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:55.295112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010e552-dd9f-4318-9c54-7c578b6d20cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:55.295979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e552-dd9f-4318-9c54-7c578b6d20cb service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:55.296278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e552-dd9f-4318-9c54-7c578b6d20cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:55.296682 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e552-dd9f-4318-9c54-7c578b6d20cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:55.392594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010e552-dd9f-4318-9c54-7c578b6d20cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:55.395135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010e552-dd9f-4318-9c54-7c578b6d20cb service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:55.408520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1340/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:58.272158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:58.434617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e3b61-fa03-4645-b6b7-47f3755298ae service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:58.453115 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:58.454367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:58.454657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:58.454930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] PATH_INFO: `/v3/users/9dcf902b69df4d8582d6279a5f97300c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:58.456323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcf902b69df4d8582d6279a5f97300c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:58.458607 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:58.465312 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:58.534527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcf902b69df4d8582d6279a5f97300c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:58.551415 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcf902b69df4d8582d6279a5f97300c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:58.552358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcf902b69df4d8582d6279a5f97300c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:58.564775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcf902b69df4d8582d6279a5f97300c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:58.580983 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcf902b69df4d8582d6279a5f97300c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:58.589495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1379/2719] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:58 2022] DELETE /identity/v3/users/9dcf902b69df4d8582d6279a5f97300c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:58.594241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:58.594735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:58.594735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:58.627597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:58.629725 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:58.714889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1341/2720] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:58.732559 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:58.734480 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:58.805387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c4320-6496-442f-928b-001a011d9bb2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:58.809711 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050c1a6-e4e4-4091-8274-f50cfbda1cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:58.810223 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050c1a6-e4e4-4091-8274-f50cfbda1cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:58.810508 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050c1a6-e4e4-4091-8274-f50cfbda1cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:58.810782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050c1a6-e4e4-4091-8274-f50cfbda1cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:58.820667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050c1a6-e4e4-4091-8274-f50cfbda1cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:58.822116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050c1a6-e4e4-4091-8274-f50cfbda1cfb service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:58.834598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1380/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:46:59.319735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:59.322213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:59.341673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a5fc1-6d54-4288-9527-7c787e6ddab3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:59.352326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:59.354116 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:59.354608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:59.355606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] PATH_INFO: `/v3/projects/6e388f88a7ec4b99baf06aa7fa12e7a5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:59.357697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e388f88a7ec4b99baf06aa7fa12e7a5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:59.362051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:59.364105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:59.432224 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:59.432660 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:59.432851 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:59.476051 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e388f88a7ec4b99baf06aa7fa12e7a5', 'request_id': 'req-14726d74-42f3-47e4-a0e6-68a3b8e4e380'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.478433 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] MFA Rules not processed for user `4d5f09dcac9a4cf696f91a804d4628e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:46:59.479780 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:59.488699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e388f88a7ec4b99baf06aa7fa12e7a5', 'request_id': 'req-14726d74-42f3-47e4-a0e6-68a3b8e4e380'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.497646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e388f88a7ec4b99baf06aa7fa12e7a5', 'request_id': 'req-14726d74-42f3-47e4-a0e6-68a3b8e4e380'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.515008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] The token cache is being invalidate because project 6e388f88a7ec4b99baf06aa7fa12e7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:46:59.515320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.518110 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.522601 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1342/2722] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:46:59 2022] DELETE /identity/v3/projects/6e388f88a7ec4b99baf06aa7fa12e7a5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:59.526467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:59.527880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:59.622832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14726d74-42f3-47e4-a0e6-68a3b8e4e380 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:59.628985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:59.629987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:59.630470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:59.630941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] PATH_INFO: `/v3/users/53c44b2e562a4051a5b3f7e0d96af65c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:59.632283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c44b2e562a4051a5b3f7e0d96af65c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:59.634800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:59.657857 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1381/2723] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:46:59.671680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:46:59.673626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:59.700610 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:59.752011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c44b2e562a4051a5b3f7e0d96af65c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.768454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c44b2e562a4051a5b3f7e0d96af65c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.769146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c44b2e562a4051a5b3f7e0d96af65c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.788130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c44b2e562a4051a5b3f7e0d96af65c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.789978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b96383a7-f2dd-43a7-9b1e-29a243a679e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c44b2e562a4051a5b3f7e0d96af65c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:46:59.809763 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f172fb-fe9c-458a-9fde-ed826daef1e7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:46:59.816357 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '876f25e90653467bb67a7f406cc9a8b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:46:59.818408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:46:59.819706 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:46:59.820290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:46:59.821552 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1343/2724] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:46:59 2022] DELETE /identity/v3/users/53c44b2e562a4051a5b3f7e0d96af65c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:46:59.823118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:46:59.911041 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:46:59.913425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:46:59.927751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1382/2725] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:46:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:47:00.047048 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.047470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.047879 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.069353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:00.070752 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:00.076878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:00.141146 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1344/2726] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:00.158241 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.160190 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:00.183487 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.186040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:00.253701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718da7-a2c8-412c-90eb-7d308e187206 service glance] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.271079 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55495e6-c857-49f6-8ab1-89721e15f959 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.276734 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.278182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.278388 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.278671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] PATH_INFO: `/v3/projects/0ae3de17fd4b4ad69b04a08d720cf1b2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.279914 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae3de17fd4b4ad69b04a08d720cf1b2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.282921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.336335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bbcc5-34af-476c-b0da-a0dbea562b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.337062 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbcc5-34af-476c-b0da-a0dbea562b35 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.337368 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbcc5-34af-476c-b0da-a0dbea562b35 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.337642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bbcc5-34af-476c-b0da-a0dbea562b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.346839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bbcc5-34af-476c-b0da-a0dbea562b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.348529 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bbcc5-34af-476c-b0da-a0dbea562b35 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.353241 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae3de17fd4b4ad69b04a08d720cf1b2', 'request_id': 'req-daa7fa93-28c0-452f-85f2-72df661cc2cd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:00.354044 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:00.358271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1383/2727] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:47:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:47:00.362109 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae3de17fd4b4ad69b04a08d720cf1b2', 'request_id': 'req-daa7fa93-28c0-452f-85f2-72df661cc2cd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:00.369499 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae3de17fd4b4ad69b04a08d720cf1b2', 'request_id': 'req-daa7fa93-28c0-452f-85f2-72df661cc2cd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:00.382614 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] The token cache is being invalidate because project 0ae3de17fd4b4ad69b04a08d720cf1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:47:00.382917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:00.384990 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-daa7fa93-28c0-452f-85f2-72df661cc2cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:00.386788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1345/2728] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:47:00 2022] DELETE /identity/v3/projects/0ae3de17fd4b4ad69b04a08d720cf1b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:00.392446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.395244 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.396277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.431883 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:00.432501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:00.515478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.515764 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.516039 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.516931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1384/2729] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:00.564513 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:00.565775 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:00.609259 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1346/2730] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:00.611070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.622591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7af4a-6b90-4180-bb28-871041a6cfb2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.640954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.641568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.641853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.642128 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.643635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:47:00.644109 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.645994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.667118 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1385/2731] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:47:00.671572 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.684443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d84468-3a6f-4bb2-94c2-4fbaeaafe015 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.689686 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.690370 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.690655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.690934 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.693186 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.695422 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.744183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1347/2732] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:47:00 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:47:00.745739 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.776239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48931b69-caff-4187-9f4f-baf0a72f5ee4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.859963 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.861216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.861503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.861776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.862482 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.865571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.901479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1386/2733] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:47:00 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:47:00.905723 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.921436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21162977-b099-4809-a6ca-7eeb79381add admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.928528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.929150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.929436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.929713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.930907 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.932679 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.945912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1348/2734] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:47:00.949900 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:00.963820 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfe22e-f63c-4971-8174-164ba91ee8b4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:00.974219 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc25b5-41ff-4897-a44a-e134d3fee571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:00.974910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc25b5-41ff-4897-a44a-e134d3fee571 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:00.975222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc25b5-41ff-4897-a44a-e134d3fee571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:00.975473 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc25b5-41ff-4897-a44a-e134d3fee571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:00.976211 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc25b5-41ff-4897-a44a-e134d3fee571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:00.977959 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc25b5-41ff-4897-a44a-e134d3fee571 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:00.990602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1387/2735] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:47:00.995156 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:01.002810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:01.007257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a1064-2319-48ab-909e-b6d995ecbb4a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:01.013786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:01.016641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.016641 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.016912 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] PATH_INFO: `/v3/projects/1911f289096a4e06a3273afc272e986a/users/be2d70a7a808499ab990643f862dfb27/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.039979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1911f289096a4e06a3273afc272e986a, user_id=be2d70a7a808499ab990643f862dfb27, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:01.042852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:01.064850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1349/2736] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:47:00 2022] PUT /identity/v3/projects/1911f289096a4e06a3273afc272e986a/users/be2d70a7a808499ab990643f862dfb27/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:01.076440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.076846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.077258 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.111130 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] MFA Rules not processed for user `be2d70a7a808499ab990643f862dfb27`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:01.112744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:01.237320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:01.259897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1388/2737] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:01.261397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:01.340325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbd580-8dfd-4e8b-a636-9eb4d3263779 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:01.345680 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:01.346432 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.346733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.347068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.347818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:01.349751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:01.396221 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1350/2738] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:47:01 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:47:01.397592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:01.409553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b11e8-4eb2-48e7-8c3b-6cc2d65f9e37 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:01.501697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:01.504201 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.504523 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.504793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.505515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:01.510127 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:01.567993 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:01.581541 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1389/2739] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:47:01 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:47:01.584199 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060625f8-848c-4b33-86df-76711a61e0b3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:01.603350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:01.604232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.604661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.605036 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.605880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:01.607888 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:01.631072 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1351/2740] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:47:01.635232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:01.652862 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8561d-914a-409f-b3c3-07de95f79d00 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:01.661086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2875938-f71e-4a42-abcb-a6db7e03c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:01.662018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875938-f71e-4a42-abcb-a6db7e03c79b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.662367 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875938-f71e-4a42-abcb-a6db7e03c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.663043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875938-f71e-4a42-abcb-a6db7e03c79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.663952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2875938-f71e-4a42-abcb-a6db7e03c79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:01.666019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2875938-f71e-4a42-abcb-a6db7e03c79b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:01.693479 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1390/2741] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:47:01.696080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:01.712511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089fcaa-7963-475c-a9a4-508f13a1cc40 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:01.722596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:01.723324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.723678 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.724027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] PATH_INFO: `/v3/projects/a6117bc238f4418dbca72f526588dc78/users/5bb8fbab01d546e68f0877fe43bfc247/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.761093 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6117bc238f4418dbca72f526588dc78, user_id=5bb8fbab01d546e68f0877fe43bfc247, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:01.763886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:01.797071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1352/2742] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:47:01 2022] PUT /identity/v3/projects/a6117bc238f4418dbca72f526588dc78/users/5bb8fbab01d546e68f0877fe43bfc247/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:01.808342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:01.808978 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:01.809432 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:01.847577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] MFA Rules not processed for user `5bb8fbab01d546e68f0877fe43bfc247`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:01.848868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:01.951990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1391/2743] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:01.956272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.083929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b50a8f-d454-4f7d-94b7-bbc7cb687ca2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:02.092430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:02.094662 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.095130 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.095580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.096766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:02.113692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:02.166959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1353/2744] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:47:01 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:47:02.170419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.196063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7705e00-3651-4e14-92f2-d587289344c6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:02.313661 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:02.314395 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.314680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.314958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.315662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:02.317657 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:02.328554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:02.358195 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1392/2745] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:47:02 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:47:02.360005 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.377946 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf0e0c-aba7-4ed1-9fed-863ea1ada0b3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:02.396056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:02.397210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.400314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.400654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.401581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:02.403242 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:02.431637 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1354/2746] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:47:02.433006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.448050 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585ebc4-f26a-4431-b0c7-1bde3618446e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:02.468877 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:02.469972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.470355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.470733 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] PATH_INFO: `/v3/projects/237a7b3e09eb45e9a88bd1db150a4923/users/99213631f88d4a08b7c67c87a4d62055/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.516339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237a7b3e09eb45e9a88bd1db150a4923, user_id=99213631f88d4a08b7c67c87a4d62055, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:02.522003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:02.551014 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1393/2747] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:47:02 2022] PUT /identity/v3/projects/237a7b3e09eb45e9a88bd1db150a4923/users/99213631f88d4a08b7c67c87a4d62055/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:02.555144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.563945 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:02.571056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983c34-de6a-49d0-87fa-6c51af953bef admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:02.665726 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bef3-61b1-46bc-97ec-b7f89e35409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:02.667071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bef3-61b1-46bc-97ec-b7f89e35409e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.667717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bef3-61b1-46bc-97ec-b7f89e35409e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.668210 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bef3-61b1-46bc-97ec-b7f89e35409e admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.669252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207bef3-61b1-46bc-97ec-b7f89e35409e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:02.671251 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207bef3-61b1-46bc-97ec-b7f89e35409e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:02.686657 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1355/2748] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:47:02.690702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.706407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0ebeb-1fa5-4bcb-b7f3-9d5eb5b206f9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:02.732617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:02.734071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.734853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.736003 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] PATH_INFO: `/v3/projects/237a7b3e09eb45e9a88bd1db150a4923/users/99213631f88d4a08b7c67c87a4d62055/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.740382 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237a7b3e09eb45e9a88bd1db150a4923, user_id=99213631f88d4a08b7c67c87a4d62055, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:02.743503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:02.756134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1394/2749] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:47:02 2022] PUT /identity/v3/projects/237a7b3e09eb45e9a88bd1db150a4923/users/99213631f88d4a08b7c67c87a4d62055/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:47:02.768538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:02.769113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:02.769113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:02.801530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] MFA Rules not processed for user `99213631f88d4a08b7c67c87a4d62055`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:02.802978 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:02.906897 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1356/2750] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:02.914606 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:02.917021 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:02.998785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137ad99-c393-48e3-af78-ffede05e8a57 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:03.003809 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:03.004778 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:03.005174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:03.006663 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:03.022407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:03.024193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:03.035553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1395/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:47:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:47:03.093069 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:03.094919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:03.111284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b1237-4d02-41b9-b0df-2b520785d3fb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:03.119323 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532f000-628e-464c-8a11-049f120ee8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:03.120163 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f000-628e-464c-8a11-049f120ee8bd service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:03.120456 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f000-628e-464c-8a11-049f120ee8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:03.120773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532f000-628e-464c-8a11-049f120ee8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:03.213292 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f000-628e-464c-8a11-049f120ee8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:03.214815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532f000-628e-464c-8a11-049f120ee8bd service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:03.239414 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1357/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:47:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:47:06.607369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:06.685738 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c818db5-65f2-4ed6-98c0-7d8eae030215 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:06.690296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:06.691185 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:06.691469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:06.691747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] PATH_INFO: `/v3/users/be2d70a7a808499ab990643f862dfb27` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:06.692979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2d70a7a808499ab990643f862dfb27)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:06.694940 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:06.758609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2d70a7a808499ab990643f862dfb27'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:06.771282 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:06.777354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2d70a7a808499ab990643f862dfb27'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:06.778868 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2d70a7a808499ab990643f862dfb27'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:06.789088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2d70a7a808499ab990643f862dfb27'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:06.797989 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2d70a7a808499ab990643f862dfb27'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:06.805296 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1396/2753] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:47:06 2022] DELETE /identity/v3/users/be2d70a7a808499ab990643f862dfb27 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:06.810138 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:06.810668 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:06.810870 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:06.829953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:06.831245 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:06.859314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:06.906386 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1358/2754] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 05:47:06.919560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:06.921444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:06.985740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c6f6-57aa-4dc5-a3e1-c12d63c0869d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:06.989462 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:06.990194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:06.990548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:06.990888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:07.002191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:07.003786 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:07.015879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1397/2755] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:47:07.336272 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:07.337813 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:07.351981 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2b675-de07-4295-94f9-4a78b2ec10e8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:07.362595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:07.363640 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:07.364056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:07.364409 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] PATH_INFO: `/v3/projects/1911f289096a4e06a3273afc272e986a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:07.365839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1911f289096a4e06a3273afc272e986a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:07.368103 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:07.452291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1911f289096a4e06a3273afc272e986a', 'request_id': 'req-a54eef84-fcb9-43b1-8f9c-483b76959aba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.478040 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1911f289096a4e06a3273afc272e986a', 'request_id': 'req-a54eef84-fcb9-43b1-8f9c-483b76959aba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.492868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1911f289096a4e06a3273afc272e986a', 'request_id': 'req-a54eef84-fcb9-43b1-8f9c-483b76959aba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.544753 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] The token cache is being invalidate because project 1911f289096a4e06a3273afc272e986a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:47:07.545022 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.546789 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.549314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1359/2756] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:47:07 2022] DELETE /identity/v3/projects/1911f289096a4e06a3273afc272e986a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:07.553638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:07.566417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09289404-8a53-442f-ab43-7f8034dbf81e service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:07.630387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:07.631086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:07.631086 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:07.631295 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] PATH_INFO: `/v3/users/5bb8fbab01d546e68f0877fe43bfc247` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:07.632575 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb8fbab01d546e68f0877fe43bfc247)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:07.634516 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:07.715943 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb8fbab01d546e68f0877fe43bfc247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.740759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb8fbab01d546e68f0877fe43bfc247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.741619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb8fbab01d546e68f0877fe43bfc247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.754194 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb8fbab01d546e68f0877fe43bfc247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.766371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb8fbab01d546e68f0877fe43bfc247'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:07.769437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:07.779187 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1398/2757] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:47:07 2022] DELETE /identity/v3/users/5bb8fbab01d546e68f0877fe43bfc247 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:08.127379 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:08.128861 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:08.168204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eef84-fcb9-43b1-8f9c-483b76959aba admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:08.238860 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:08.239749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:08.240031 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:08.240304 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] PATH_INFO: `/v3/projects/a6117bc238f4418dbca72f526588dc78` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:08.241543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6117bc238f4418dbca72f526588dc78)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:08.243454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:08.298824 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6117bc238f4418dbca72f526588dc78', 'request_id': 'req-7e960150-b046-421c-b7cd-3f968dd35ca1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.302283 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:08.312623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6117bc238f4418dbca72f526588dc78', 'request_id': 'req-7e960150-b046-421c-b7cd-3f968dd35ca1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.323218 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6117bc238f4418dbca72f526588dc78', 'request_id': 'req-7e960150-b046-421c-b7cd-3f968dd35ca1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.343623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] The token cache is being invalidate because project a6117bc238f4418dbca72f526588dc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:47:08.343988 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.346505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.350399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1360/2758] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:47:08 2022] DELETE /identity/v3/projects/a6117bc238f4418dbca72f526588dc78 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:08.354719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:08.356246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:08.375854 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ce84-fa26-4f90-bf90-929a931747fc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:08.457189 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:08.458239 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:08.458551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:08.458824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] PATH_INFO: `/v3/users/99213631f88d4a08b7c67c87a4d62055` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:08.460024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99213631f88d4a08b7c67c87a4d62055)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:08.462971 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:08.520534 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99213631f88d4a08b7c67c87a4d62055'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.536193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99213631f88d4a08b7c67c87a4d62055'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.537001 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99213631f88d4a08b7c67c87a4d62055'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.546625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99213631f88d4a08b7c67c87a4d62055'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.557221 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cecc467b-28cf-43aa-b592-47f05f5bd193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99213631f88d4a08b7c67c87a4d62055'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:08.564225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1399/2759] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:47:08 2022] DELETE /identity/v3/users/99213631f88d4a08b7c67c87a4d62055 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:08.884823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:08.886719 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:08.909080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960150-b046-421c-b7cd-3f968dd35ca1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:08.987821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:08.989068 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:08.989529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:08.989995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] PATH_INFO: `/v3/projects/237a7b3e09eb45e9a88bd1db150a4923` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:08.993076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237a7b3e09eb45e9a88bd1db150a4923)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:08.995375 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:09.061915 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237a7b3e09eb45e9a88bd1db150a4923', 'request_id': 'req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:09.073070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237a7b3e09eb45e9a88bd1db150a4923', 'request_id': 'req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:09.080458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237a7b3e09eb45e9a88bd1db150a4923', 'request_id': 'req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:09.094889 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] The token cache is being invalidate because project 237a7b3e09eb45e9a88bd1db150a4923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:47:09.095314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:09.096088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:47:09.097979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1361/2760] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:47:08 2022] DELETE /identity/v3/projects/237a7b3e09eb45e9a88bd1db150a4923 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:47:10.849536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986aedb-3999-49d1-bd31-56e710dc2730 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:10.850024 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986aedb-3999-49d1-bd31-56e710dc2730 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:10.850120 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986aedb-3999-49d1-bd31-56e710dc2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:10.868142 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b986aedb-3999-49d1-bd31-56e710dc2730 None None] MFA Rules not processed for user `15732421836841f494ecc67fa75cf4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:10.869372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b986aedb-3999-49d1-bd31-56e710dc2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:10.929798 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1400/2761] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:11.449525 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:11.451228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:11.516589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e2ad7-bc2a-433e-83ce-fa5cbd9e20f5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:11.521538 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:11.522228 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:11.522508 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:11.522766 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:11.525027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:11.534877 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:11.536320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:11.544541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1362/2762] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:47:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:47:13.093246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:13.093732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:13.093925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:13.112531 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:13.113748 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:13.133070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:13.171999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1401/2763] 10.222.0.18 () {58 vars in 1009 bytes} [Thu Jul 21 05:47:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:47:13.185073 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:13.186493 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:13.199911 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:13.257613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b4919-6f6c-47b2-9a96-cafaac95b54e service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:13.262664 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bce13-d25d-45af-87b7-35578c436226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:13.263319 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bce13-d25d-45af-87b7-35578c436226 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:13.263603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bce13-d25d-45af-87b7-35578c436226 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:13.263874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bce13-d25d-45af-87b7-35578c436226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:13.272418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bce13-d25d-45af-87b7-35578c436226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:13.274076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bce13-d25d-45af-87b7-35578c436226 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:13.282086 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1363/2764] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:47:23.165184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=14 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:23.279012 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=27 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:34.365165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:47:34.375596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8355d1c-f7dd-4e15-a9de-6d7b9b70f4b9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:47:34.380149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:47:34.380835 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:34.381119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:34.381397 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:34.383376 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:34.449134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:47:34.450588 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:47:34.460375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1402/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:47:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:47:44.455977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=30 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:51.948569 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:47:51.949148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:47:51.949148 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:47:51.979234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] MFA Rules not processed for user `45ea3dcaa289463dad658f45d95a4ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:47:51.980522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:47:52.060875 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1364/2766] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:47:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:48:00.432202 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:48:00.433926 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:00.586884 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb39ed9-739c-4609-8790-e4d8a2297d07 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:48:00.592972 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:48:00.593623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:00.593914 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:00.594180 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:00.596164 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:00.608037 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:48:00.609662 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:48:00.619488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1403/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:48:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:48:02.058711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=37 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:08.686351 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:48:08.699324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c2c6f-4985-4e3e-8e40-ef2ccc44a838 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:48:08.709117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:48:08.709117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:08.709117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:08.709117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:08.709554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:08.720421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:48:08.722119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:48:08.732394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1365/2768] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:48:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:48:08.751416 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:48:08.753490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:08.841168 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:08.848927 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544986be-4664-4d14-84d1-c063d31700a3 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:48:08.853614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:48:08.854485 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:08.854760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:08.855031 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] PATH_INFO: `/v3/users/92074e992399406c969d11eb97bff469` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:08.856222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=92074e992399406c969d11eb97bff469)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:48:08.858174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:48:08.906332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92074e992399406c969d11eb97bff469'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:08.918874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92074e992399406c969d11eb97bff469'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:08.919581 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92074e992399406c969d11eb97bff469'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:08.928893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92074e992399406c969d11eb97bff469'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:08.935895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92074e992399406c969d11eb97bff469'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:08.942055 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1404/2769] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:48:08 2022] DELETE /identity/v3/users/92074e992399406c969d11eb97bff469 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:48:09.130724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:48:09.142549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30120db1-a386-41d3-8db2-bf39298da358 service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:48:09.200594 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:48:09.201412 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:09.201697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:09.201971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] PATH_INFO: `/v3/projects/1643b6c460de4711823f725fd61718a4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:09.203661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1643b6c460de4711823f725fd61718a4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:48:09.205623 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:48:09.258490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1643b6c460de4711823f725fd61718a4', 'request_id': 'req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.268268 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1643b6c460de4711823f725fd61718a4', 'request_id': 'req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.275621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1643b6c460de4711823f725fd61718a4', 'request_id': 'req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.286320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] The token cache is being invalidate because project 1643b6c460de4711823f725fd61718a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:48:09.286672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.287369 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.289043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1366/2770] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:48:09 2022] DELETE /identity/v3/projects/1643b6c460de4711823f725fd61718a4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:48:09.293342 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:48:09.294865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:09.308592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aa511-4139-4022-857c-8cc279eaa1cc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:48:09.370784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:48:09.371665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:09.371946 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:09.372225 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] PATH_INFO: `/v3/users/5ae53b91e0ed4196918c1c5b051d774c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:09.373471 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae53b91e0ed4196918c1c5b051d774c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:48:09.375454 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:48:09.434613 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae53b91e0ed4196918c1c5b051d774c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.446759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae53b91e0ed4196918c1c5b051d774c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.447445 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae53b91e0ed4196918c1c5b051d774c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.457104 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae53b91e0ed4196918c1c5b051d774c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.459198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:09.465730 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a38a87f8-5612-40a6-8383-a94534f9cc91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae53b91e0ed4196918c1c5b051d774c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.473016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1405/2771] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:48:09 2022] DELETE /identity/v3/users/5ae53b91e0ed4196918c1c5b051d774c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:48:09.650757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:48:09.652372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:09.667172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc16ae-0d33-45f3-bbae-23a36d7d2db3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:48:09.726558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:48:09.727342 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:09.727621 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:09.727895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] PATH_INFO: `/v3/projects/555e582807ee49aca6d226a6243b2ac7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:09.729136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=555e582807ee49aca6d226a6243b2ac7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:48:09.731056 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:48:09.752425 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:09.781382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555e582807ee49aca6d226a6243b2ac7', 'request_id': 'req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.790081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555e582807ee49aca6d226a6243b2ac7', 'request_id': 'req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.796957 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555e582807ee49aca6d226a6243b2ac7', 'request_id': 'req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.808693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] The token cache is being invalidate because project 555e582807ee49aca6d226a6243b2ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:48:09.808979 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.809716 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-60aa7467-faba-4ca7-8d9c-e7cf14db9b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:48:09.811399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1367/2772] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:48:09 2022] DELETE /identity/v3/projects/555e582807ee49aca6d226a6243b2ac7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:48:19.473941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:19.805312 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:50.828680 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:48:50.829251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:48:50.829251 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:48:50.846954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] MFA Rules not processed for user `45ea3dcaa289463dad658f45d95a4ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:48:50.848158 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:48:50.905487 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1406/2773] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:48:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:00.898494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=25 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:09.437874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:09.438356 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:09.438454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:09.467220 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] MFA Rules not processed for user `c0c4748fca7c432197e57f6a2d952fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:09.468517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:09.533361 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1368/2774] 10.222.0.18 () {58 vars in 967 bytes} [Thu Jul 21 05:49:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:09.573101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:09.574724 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:09.645979 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab60dd-b638-4889-baee-f127808f1acf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:09.651630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18feb5be4814673933b8e140a91b2a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:09.652271 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:09.652578 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:09.652846 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:09.661290 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:09.662872 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:09.670941 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1407/2775] 10.222.0.18 () {60 vars in 1384 bytes} [Thu Jul 21 05:49:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 05:49:16.307338 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:16.309113 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:16.379264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398089-dd47-4482-b90d-ea6df55b0223 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:16.383865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:16.385134 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:16.385418 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:16.385694 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] PATH_INFO: `/v3/users/15732421836841f494ecc67fa75cf4bf` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:16.387001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15732421836841f494ecc67fa75cf4bf)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:16.389013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:16.439573 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15732421836841f494ecc67fa75cf4bf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.448089 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15732421836841f494ecc67fa75cf4bf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.448744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15732421836841f494ecc67fa75cf4bf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.456453 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15732421836841f494ecc67fa75cf4bf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.457213 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15732421836841f494ecc67fa75cf4bf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.474055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1369/2776] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:49:16 2022] DELETE /identity/v3/users/15732421836841f494ecc67fa75cf4bf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:16.679685 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:16.690497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e15357-0d8b-4854-bf09-9b03cf9ab2d4 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:16.747099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:16.747964 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:16.748238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:16.748526 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] PATH_INFO: `/v3/projects/12ed317250324a1a8459fe930b1264ac` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:16.749832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ed317250324a1a8459fe930b1264ac)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:16.752010 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:16.802101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ed317250324a1a8459fe930b1264ac', 'request_id': 'req-6c8f6418-1127-4726-8c1b-bd8aadd81121'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.807650 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ed317250324a1a8459fe930b1264ac', 'request_id': 'req-6c8f6418-1127-4726-8c1b-bd8aadd81121'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.816102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ed317250324a1a8459fe930b1264ac', 'request_id': 'req-6c8f6418-1127-4726-8c1b-bd8aadd81121'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.827078 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] The token cache is being invalidate because project 12ed317250324a1a8459fe930b1264ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:49:16.827371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.828043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:16.829674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1408/2777] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:49:16 2022] DELETE /identity/v3/projects/12ed317250324a1a8459fe930b1264ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:16.833951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:16.835704 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:16.854891 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40a00-b272-403e-a713-d2f728ce0d27 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:16.860470 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:16.919198 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:16.920566 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:16.920973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:16.921244 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] PATH_INFO: `/v3/users/4d5f09dcac9a4cf696f91a804d4628e0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:16.923385 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5f09dcac9a4cf696f91a804d4628e0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:16.926706 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:17.116105 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5f09dcac9a4cf696f91a804d4628e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.124145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5f09dcac9a4cf696f91a804d4628e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.124830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5f09dcac9a4cf696f91a804d4628e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.131921 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5f09dcac9a4cf696f91a804d4628e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.132598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5f09dcac9a4cf696f91a804d4628e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.151097 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1370/2778] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:49:16 2022] DELETE /identity/v3/users/4d5f09dcac9a4cf696f91a804d4628e0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:17.330094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:17.331572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:17.346552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6418-1127-4726-8c1b-bd8aadd81121 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:17.367468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:17.410088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:17.411051 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:17.411330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:17.411596 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] PATH_INFO: `/v3/projects/83d9e3ec0a6f446ea999b125907b4ec6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:17.412950 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d9e3ec0a6f446ea999b125907b4ec6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:17.414921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:17.465577 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d9e3ec0a6f446ea999b125907b4ec6', 'request_id': 'req-a15eda8c-e13f-411d-87b9-5617df881748'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.471564 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d9e3ec0a6f446ea999b125907b4ec6', 'request_id': 'req-a15eda8c-e13f-411d-87b9-5617df881748'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.479498 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d9e3ec0a6f446ea999b125907b4ec6', 'request_id': 'req-a15eda8c-e13f-411d-87b9-5617df881748'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.490793 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] The token cache is being invalidate because project 83d9e3ec0a6f446ea999b125907b4ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:49:17.491079 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.491785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:17.493469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1409/2779] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:49:17 2022] DELETE /identity/v3/projects/83d9e3ec0a6f446ea999b125907b4ec6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:27.147562 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:27.487901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:50.796703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:50.799182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:50.813252 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07119ba-3b61-4bcb-9754-82807e4f752b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:50.874502 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:50.875397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:50.875685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:50.875986 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] PATH_INFO: `/v3/users/45ea3dcaa289463dad658f45d95a4ea0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:50.877168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ea3dcaa289463dad658f45d95a4ea0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:50.879144 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:50.928859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ea3dcaa289463dad658f45d95a4ea0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:50.937721 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ea3dcaa289463dad658f45d95a4ea0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:50.938344 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ea3dcaa289463dad658f45d95a4ea0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:50.945337 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ea3dcaa289463dad658f45d95a4ea0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:50.945973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-99f77260-ae4f-4ac5-b58e-a4acde928b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ea3dcaa289463dad658f45d95a4ea0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:50.963334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1371/2780] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:49:50 2022] DELETE /identity/v3/users/45ea3dcaa289463dad658f45d95a4ea0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:51.141982 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.143488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:51.156682 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eda8c-e13f-411d-87b9-5617df881748 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.215803 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.216722 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.217005 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.217280 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] PATH_INFO: `/v3/projects/c3ffb24afb724962a17c8ba65ee26569` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.218497 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ffb24afb724962a17c8ba65ee26569)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.220468 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.269520 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ffb24afb724962a17c8ba65ee26569', 'request_id': 'req-f38bd84a-6215-40c4-9081-a7731b67ad7d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:51.275043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ffb24afb724962a17c8ba65ee26569', 'request_id': 'req-f38bd84a-6215-40c4-9081-a7731b67ad7d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:51.283284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ffb24afb724962a17c8ba65ee26569', 'request_id': 'req-f38bd84a-6215-40c4-9081-a7731b67ad7d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:51.294033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] The token cache is being invalidate because project c3ffb24afb724962a17c8ba65ee26569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:49:51.294321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:51.294951 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f38bd84a-6215-40c4-9081-a7731b67ad7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:51.296490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1410/2781] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:49:51 2022] DELETE /identity/v3/projects/c3ffb24afb724962a17c8ba65ee26569 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:51.301553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.301835 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.302158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.359478 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:51.360869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:51.408547 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:51.427389 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1372/2782] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:51.435261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.435552 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.435830 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.454444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:51.455652 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:51.464358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1411/2783] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:51.468658 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.478806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5abe7-53c2-418c-9ec7-f18880ecb321 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.484631 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.485318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.485622 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.485894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.486655 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:49:51.486960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.488606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.501232 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1373/2784] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:49:51.505619 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.515675 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b534-dee5-4ea7-84f2-3c8295741b86 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.521679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.522335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.522622 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.522893 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.523583 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.525648 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.563853 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1412/2785] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:49:51 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:49:51.568112 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.578038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e678-8fc6-4872-a1f6-d566a01f339d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.636192 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.636833 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.637117 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.637398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.638090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.640054 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.662920 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1374/2786] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:49:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:49:51.667162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.678006 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941ebd9-c85b-4bf6-84d1-abb85c55baf7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.683387 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.684174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.684553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.684925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.685752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.687446 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.697975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1413/2787] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:49:51.702430 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.712869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a4ef1-ec05-4317-8395-0870de171b5a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.718365 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ae7ab-5a17-40cd-89a6-f0893dee7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.719059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae7ab-5a17-40cd-89a6-f0893dee7a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.719321 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae7ab-5a17-40cd-89a6-f0893dee7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.719585 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ae7ab-5a17-40cd-89a6-f0893dee7a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.720395 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ae7ab-5a17-40cd-89a6-f0893dee7a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.721929 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ae7ab-5a17-40cd-89a6-f0893dee7a2a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.733013 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1375/2788] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:49:51.737438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.747628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183dc6-b4a3-4ccc-abe9-8d598623e15c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:51.752348 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:51.753262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.753545 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.753819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] PATH_INFO: `/v3/projects/84a682e99b1b4d19b5913800823cca94/users/aaeeff62c86d4713aa975be0d673ca29/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.769064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a682e99b1b4d19b5913800823cca94, user_id=aaeeff62c86d4713aa975be0d673ca29, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:51.771731 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:51.787111 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1414/2789] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:49:51 2022] PUT /identity/v3/projects/84a682e99b1b4d19b5913800823cca94/users/aaeeff62c86d4713aa975be0d673ca29/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:51.798326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:51.798818 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:51.798927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:51.826589 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] MFA Rules not processed for user `aaeeff62c86d4713aa975be0d673ca29`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:51.827794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:51.897158 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1376/2790] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:51.908609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:51.910615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:51.934366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:52.008635 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcb1bd-11ca-4bba-9d14-e0660c62fc03 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:52.015784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dec687-6f3b-4cda-8fd0-181df0fa5880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e2cefbcf0449ff8fb8b695bba26dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:52.016444 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dec687-6f3b-4cda-8fd0-181df0fa5880 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:52.016764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dec687-6f3b-4cda-8fd0-181df0fa5880 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:52.017038 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dec687-6f3b-4cda-8fd0-181df0fa5880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:52.026484 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dec687-6f3b-4cda-8fd0-181df0fa5880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:52.028099 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dec687-6f3b-4cda-8fd0-181df0fa5880 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:52.037839 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1415/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:49:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:49:52.251270 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:52.300301 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:52.319876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27636e6-3b72-47f2-a38a-6058771dde25 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:52.325071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:52.325980 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:52.326256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:52.326527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] PATH_INFO: `/v3/users/aaeeff62c86d4713aa975be0d673ca29` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:52.327751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaeeff62c86d4713aa975be0d673ca29)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:52.329687 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:52.379670 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaeeff62c86d4713aa975be0d673ca29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:52.387505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaeeff62c86d4713aa975be0d673ca29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:52.388191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaeeff62c86d4713aa975be0d673ca29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:52.395176 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaeeff62c86d4713aa975be0d673ca29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:52.395843 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaeeff62c86d4713aa975be0d673ca29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:52.413869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1377/2792] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:49:52 2022] DELETE /identity/v3/users/aaeeff62c86d4713aa975be0d673ca29 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:52.418500 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:52.419020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:52.419020 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:52.436980 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:52.438193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:52.498647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1416/2793] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:52.511043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:52.512693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:52.594263 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb5dfb-75e9-4470-84ce-913c058a5873 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:52.598517 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384986-9563-44d8-870b-6d02dfb14042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:52.599160 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384986-9563-44d8-870b-6d02dfb14042 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:52.599441 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384986-9563-44d8-870b-6d02dfb14042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:52.599698 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384986-9563-44d8-870b-6d02dfb14042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:52.609046 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0384986-9563-44d8-870b-6d02dfb14042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:52.610472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0384986-9563-44d8-870b-6d02dfb14042 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:52.619960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1378/2794] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 05:49:52.908408 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:52.910166 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:52.922390 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd942efc-c922-4438-82af-a8266fb8660c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:52.927775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:52.928917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:52.929291 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:52.929453 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] PATH_INFO: `/v3/projects/84a682e99b1b4d19b5913800823cca94` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:52.930850 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a682e99b1b4d19b5913800823cca94)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:52.933602 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:52.986114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a682e99b1b4d19b5913800823cca94', 'request_id': 'req-e88aaafa-7dcb-483b-b344-f05005e3f881'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:52.991703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a682e99b1b4d19b5913800823cca94', 'request_id': 'req-e88aaafa-7dcb-483b-b344-f05005e3f881'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:53.000832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a682e99b1b4d19b5913800823cca94', 'request_id': 'req-e88aaafa-7dcb-483b-b344-f05005e3f881'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:53.012937 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] The token cache is being invalidate because project 84a682e99b1b4d19b5913800823cca94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:49:53.013222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:53.013921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e88aaafa-7dcb-483b-b344-f05005e3f881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:53.015567 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1417/2795] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:49:52 2022] DELETE /identity/v3/projects/84a682e99b1b4d19b5913800823cca94 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:53.022024 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.022528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.022638 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.041115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:53.042333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:53.083864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:53.103055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1379/2796] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:53.111032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.111321 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.111609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.124967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:53.130193 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:53.132555 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:53.140934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1418/2797] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:53.145222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.155398 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136aa7e-eb94-4430-8359-48d0b0f9b7a1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.160756 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.161490 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.161774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.162122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.162924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:49:53.163261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.165100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.177377 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1380/2798] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:49:53.182110 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.191751 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134272b-b285-4648-a8a6-e09d1a89519d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.197132 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.197721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.197997 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.198262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.198921 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.200865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.230430 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1419/2799] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:49:53 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:49:53.235806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.246512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca72c-f07e-43fb-b7e3-55a3347eb967 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.303421 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.304085 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.304363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.304996 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.305703 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.307575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.328648 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1381/2800] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:49:53 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:49:53.332888 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.343528 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b101c-7854-46f0-b700-a60e304dff53 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.349034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.349707 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.349977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.351535 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.351735 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.353385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.366263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1420/2801] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:49:53.370434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.380707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b649e89-3aac-46ef-bf6d-f3ec576ed756 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.386950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dee3ff-d7a1-4ae5-9731-6f1c486983f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.387608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dee3ff-d7a1-4ae5-9731-6f1c486983f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.387890 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dee3ff-d7a1-4ae5-9731-6f1c486983f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.388159 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dee3ff-d7a1-4ae5-9731-6f1c486983f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.388924 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dee3ff-d7a1-4ae5-9731-6f1c486983f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.390520 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dee3ff-d7a1-4ae5-9731-6f1c486983f1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.400868 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1382/2802] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:49:53.404991 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.415674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a161-3e79-458e-9873-74c352c723ad admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.421451 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.422339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.422615 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.422885 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] PATH_INFO: `/v3/projects/c91d244b8fb649229927c14fe791afaf/users/a124db1d58004bf1a22e9500f7dbe421/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.440725 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91d244b8fb649229927c14fe791afaf, user_id=a124db1d58004bf1a22e9500f7dbe421, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.443443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.459117 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1421/2803] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:49:53 2022] PUT /identity/v3/projects/c91d244b8fb649229927c14fe791afaf/users/a124db1d58004bf1a22e9500f7dbe421/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:53.469468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.469883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.470195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.497671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] MFA Rules not processed for user `a124db1d58004bf1a22e9500f7dbe421`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:53.498876 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:53.567553 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1383/2804] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:53.578840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:53.580936 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:53.661834 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d0023-ca1b-4a24-aa34-7a2c419c7200 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:53.666330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e384fd-6aa0-4a8f-ad30-b602b1c41501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:53.666977 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e384fd-6aa0-4a8f-ad30-b602b1c41501 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:53.667260 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e384fd-6aa0-4a8f-ad30-b602b1c41501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:53.667537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e384fd-6aa0-4a8f-ad30-b602b1c41501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:53.679412 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e384fd-6aa0-4a8f-ad30-b602b1c41501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:53.680905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e384fd-6aa0-4a8f-ad30-b602b1c41501 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:53.690347 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1422/2805] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:49:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:49:59.107527 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:59.156016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:59.181150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418952d7-9498-48c9-a1d6-097f429627eb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:59.186353 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:59.187234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:59.187512 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:59.187806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] PATH_INFO: `/v3/users/a124db1d58004bf1a22e9500f7dbe421` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:59.189061 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a124db1d58004bf1a22e9500f7dbe421)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:59.191008 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:59.240867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a124db1d58004bf1a22e9500f7dbe421'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.250599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a124db1d58004bf1a22e9500f7dbe421'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.251169 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a124db1d58004bf1a22e9500f7dbe421'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.258471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a124db1d58004bf1a22e9500f7dbe421'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.259104 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a124db1d58004bf1a22e9500f7dbe421'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.276011 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1384/2806] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:49:59 2022] DELETE /identity/v3/users/a124db1d58004bf1a22e9500f7dbe421 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:59.280776 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:59.281257 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:59.281379 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:59.299784 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:59.301015 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:59.365962 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1423/2807] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:59.379191 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:59.381092 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:59.446659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d573f5d-561f-40f1-a1fb-c922e16a34fe admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:59.451285 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df739a68-05e3-4389-8f92-6e1de939a282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:59.452026 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df739a68-05e3-4389-8f92-6e1de939a282 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:59.452320 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df739a68-05e3-4389-8f92-6e1de939a282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:59.452613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df739a68-05e3-4389-8f92-6e1de939a282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:59.461936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df739a68-05e3-4389-8f92-6e1de939a282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:59.463373 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df739a68-05e3-4389-8f92-6e1de939a282 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:59.473357 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1385/2808] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:49:59.756354 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:59.758310 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:59.772253 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835ced-1c78-4ff9-b8e7-85fa5d59553c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:49:59.777787 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:49:59.778719 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:59.778998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:59.779369 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] PATH_INFO: `/v3/projects/c91d244b8fb649229927c14fe791afaf` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:59.780665 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91d244b8fb649229927c14fe791afaf)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:49:59.782630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:49:59.805672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:59.830286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91d244b8fb649229927c14fe791afaf', 'request_id': 'req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.836267 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91d244b8fb649229927c14fe791afaf', 'request_id': 'req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.845750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91d244b8fb649229927c14fe791afaf', 'request_id': 'req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.856897 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] The token cache is being invalidate because project c91d244b8fb649229927c14fe791afaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:49:59.857179 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.857821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9613d99a-863e-4a5b-bc3a-bfeae3d29d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:49:59.859370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1424/2809] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:49:59 2022] DELETE /identity/v3/projects/c91d244b8fb649229927c14fe791afaf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:49:59.864588 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:59.864880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:59.865157 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:59.883080 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:59.884209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:59.947646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1386/2810] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:59.956984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:49:59.957270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:49:59.957546 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:49:59.976018 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:49:59.977246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:49:59.986119 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1425/2811] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:49:59.990324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:49:59.996336 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:00.000598 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9c6c9-1734-4d51-97f9-0aed5f0a0c4e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.007226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.007917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.008343 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.008669 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.009609 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:50:00.009937 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.011916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.023497 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1387/2812] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:50:00.028034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:00.038094 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058850-5b8a-4b45-9c43-a6eaf200d77c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.044146 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.044844 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.045184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.045455 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.046138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.048042 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.076600 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1426/2813] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:00 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:00.080951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:00.091507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ec958-fa02-4500-bb25-70ad83b0a461 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.149823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.150491 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.150675 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.150950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.151642 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.153580 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.173948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1388/2814] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:00 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:50:00.178238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:00.188712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cca2ec-eaf2-4951-8c68-0fcc8b13cf09 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.193988 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.194670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.194952 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.195536 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.195954 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.197591 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.208574 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1427/2815] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:00.212865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:00.223275 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804d0e9-8e8d-4e30-b10d-c181654ead94 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.228555 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688febe-f137-4465-ba0b-c12fa81850ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.229246 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688febe-f137-4465-ba0b-c12fa81850ef admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.229528 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688febe-f137-4465-ba0b-c12fa81850ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.229802 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688febe-f137-4465-ba0b-c12fa81850ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.230529 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688febe-f137-4465-ba0b-c12fa81850ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.232121 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688febe-f137-4465-ba0b-c12fa81850ef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.243869 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1389/2816] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:00.248030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:00.258712 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423d2bc-3920-43d9-8373-c213e34c26cc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.264742 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.265628 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.265901 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.266173 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] PATH_INFO: `/v3/projects/6f0500a3ab1f49169b6e553a8bdd782b/users/cd675477830742938d857de3e0736b07/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.281630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0500a3ab1f49169b6e553a8bdd782b, user_id=cd675477830742938d857de3e0736b07, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.284284 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.300533 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1428/2817] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:00 2022] PUT /identity/v3/projects/6f0500a3ab1f49169b6e553a8bdd782b/users/cd675477830742938d857de3e0736b07/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:00.311007 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.311291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.311544 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.338561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] MFA Rules not processed for user `cd675477830742938d857de3e0736b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:00.339735 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:00.404177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1390/2818] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:00.415205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:00.417233 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:00.486504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480d73e-1884-414c-b6af-f1114df1c1a9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:00.491554 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c48e2-f3dc-43a5-8877-cd8fbf254349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:00.492205 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c48e2-f3dc-43a5-8877-cd8fbf254349 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:00.492626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c48e2-f3dc-43a5-8877-cd8fbf254349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:00.492910 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c48e2-f3dc-43a5-8877-cd8fbf254349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:00.503824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c48e2-f3dc-43a5-8877-cd8fbf254349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:00.505388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c48e2-f3dc-43a5-8877-cd8fbf254349 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:00.514880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1429/2819] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:03.572262 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:03.638742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932033-f003-46c5-9e5f-e273c134471f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:03.643821 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:03.644749 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:03.645027 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:03.645295 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] PATH_INFO: `/v3/users/cd675477830742938d857de3e0736b07` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:03.646646 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd675477830742938d857de3e0736b07)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:03.648624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:03.650175 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:03.707688 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd675477830742938d857de3e0736b07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:03.716154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd675477830742938d857de3e0736b07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:03.716793 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd675477830742938d857de3e0736b07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:03.723894 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd675477830742938d857de3e0736b07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:03.724514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd675477830742938d857de3e0736b07'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:03.741787 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1391/2820] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:03 2022] DELETE /identity/v3/users/cd675477830742938d857de3e0736b07 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:03.746388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:03.746876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:03.746990 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:03.765517 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:03.766827 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:03.815240 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:03.832075 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1430/2821] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:03.841928 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:03.843483 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:03.901829 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d54992-5491-4a41-9b61-465086016cc2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:03.905590 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e36ec-3309-435a-844c-4e600cae0dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:03.906237 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e36ec-3309-435a-844c-4e600cae0dfc service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:03.906518 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e36ec-3309-435a-844c-4e600cae0dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:03.906790 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e36ec-3309-435a-844c-4e600cae0dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:03.915832 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e36ec-3309-435a-844c-4e600cae0dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:03.917305 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e36ec-3309-435a-844c-4e600cae0dfc service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:03.926685 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1392/2822] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:04.201442 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.202916 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:04.215228 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932408e-6044-4f35-989a-3fd838932cd7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.220420 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.221362 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.221641 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.221886 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] PATH_INFO: `/v3/projects/6f0500a3ab1f49169b6e553a8bdd782b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.223856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0500a3ab1f49169b6e553a8bdd782b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.225795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.276270 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0500a3ab1f49169b6e553a8bdd782b', 'request_id': 'req-ecf85fe6-b341-4223-b100-439b94b2762b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:04.281805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0500a3ab1f49169b6e553a8bdd782b', 'request_id': 'req-ecf85fe6-b341-4223-b100-439b94b2762b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:04.291425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0500a3ab1f49169b6e553a8bdd782b', 'request_id': 'req-ecf85fe6-b341-4223-b100-439b94b2762b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:04.309385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] The token cache is being invalidate because project 6f0500a3ab1f49169b6e553a8bdd782b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:04.309732 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:04.310782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ecf85fe6-b341-4223-b100-439b94b2762b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:04.313203 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1431/2823] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:04 2022] DELETE /identity/v3/projects/6f0500a3ab1f49169b6e553a8bdd782b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:04.318815 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.319100 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.319366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.337916 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:04.339119 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:04.398216 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1393/2824] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:04.407268 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.407560 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.407824 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.427301 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:04.428568 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:04.437717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1432/2825] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:04.442217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.451865 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bcdd8-ae03-4c20-9834-2cb659d4c62b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.456884 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.457531 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.457809 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.458076 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.458796 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:50:04.459101 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.460715 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.472382 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1394/2826] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:50:04.476595 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.486217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274d59-e487-49ea-9fd2-246b9b085218 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.491614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.492256 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.492570 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.492840 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.493525 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.495515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.524030 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1433/2827] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:04.528403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.538636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25483edf-fd81-4336-bb64-7fb6496e8d1c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.543901 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:04.597203 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.597831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.598133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.598404 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.599123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.601067 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.624070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1395/2828] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:50:04.628572 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.640782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9415557-9ff3-4741-aaa6-98ced4fac3df admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.646431 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.647091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.647378 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.647647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.648370 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.650071 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.660744 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1434/2829] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:04.664560 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.674519 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3895b-3054-4249-97b6-8336936821d3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.679362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d546-bdee-4cc1-98da-84ed2563a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.680006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d546-bdee-4cc1-98da-84ed2563a012 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.680289 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d546-bdee-4cc1-98da-84ed2563a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.680596 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d546-bdee-4cc1-98da-84ed2563a012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.681325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d546-bdee-4cc1-98da-84ed2563a012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.682917 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d546-bdee-4cc1-98da-84ed2563a012 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.693166 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1396/2830] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:50:04.697313 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.707878 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe17b6-d56e-493f-a3c4-a9f932e22835 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.713332 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.714213 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.714494 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.714767 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] PATH_INFO: `/v3/projects/c31f348ea0c340e787fb0cbb10374fc5/users/a0cff240f999432da0adb634562801f4/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.730759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31f348ea0c340e787fb0cbb10374fc5, user_id=a0cff240f999432da0adb634562801f4, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.733475 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.748879 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1435/2831] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:04 2022] PUT /identity/v3/projects/c31f348ea0c340e787fb0cbb10374fc5/users/a0cff240f999432da0adb634562801f4/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:04.759783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.760098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.760372 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.787400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] MFA Rules not processed for user `a0cff240f999432da0adb634562801f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:04.788561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:04.854290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1397/2832] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:04.858701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.924819 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065859c6-6eea-492c-8757-ce71231eb2e7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:04.933808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:04.934656 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:04.934985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:04.935345 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:04.936386 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:04.939184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:04.953070 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:04.968807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1436/2833] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:04.973380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:04.984322 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d53ee-d7b3-40d8-b491-fd901f379957 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.044762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.045446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.045765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.046043 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.046748 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.048696 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.069674 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1398/2834] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:04 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 05:50:05.073512 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.084339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c387ac-c2b3-4e71-a196-977ec2f60aa8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.089399 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.090067 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.090358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.090636 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.091371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.093162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.103958 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1437/2835] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:05.107902 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.118575 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da712ca5-256f-42c9-98bc-a3601aeb3600 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.124509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bc3a-3ead-441d-9999-fa8da2b19d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.125185 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bc3a-3ead-441d-9999-fa8da2b19d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.125463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bc3a-3ead-441d-9999-fa8da2b19d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.125710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bc3a-3ead-441d-9999-fa8da2b19d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.126471 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bc3a-3ead-441d-9999-fa8da2b19d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.128066 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bc3a-3ead-441d-9999-fa8da2b19d73 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.129311 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:05.140878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1399/2836] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:05.144752 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.154740 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c40a8c-75c5-4185-b296-d9f6def0aa74 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.159438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.160319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.160634 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.160912 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] PATH_INFO: `/v3/projects/fde1368ac2464cf3b365838c61ee486d/users/f5e2fdb0428e41a9a83120e6c80830f2/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.175438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde1368ac2464cf3b365838c61ee486d, user_id=f5e2fdb0428e41a9a83120e6c80830f2, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.178126 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.192232 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1438/2837] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:05 2022] PUT /identity/v3/projects/fde1368ac2464cf3b365838c61ee486d/users/f5e2fdb0428e41a9a83120e6c80830f2/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:50:05.202918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.203234 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.203510 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.231204 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] MFA Rules not processed for user `f5e2fdb0428e41a9a83120e6c80830f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:05.232396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:05.308960 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1400/2838] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:05.313717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.386876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72807ec-a3bd-44d1-9ab3-82fe3b07e89b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.392569 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.393229 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.393504 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.393777 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.394495 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.396449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.423702 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1439/2839] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:05 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:05.428168 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.439081 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a97866-6e9a-42be-b4fb-f2dcba867b40 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.495350 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.496006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.496720 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.496995 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.497676 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.499574 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.521034 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1401/2840] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:05 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:05.525488 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.536184 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a653245-9e92-43f6-918f-395635b592ba admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.540896 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.541542 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.541823 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.542088 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.542810 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.544428 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.554814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1440/2841] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:05.558873 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.568788 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf006f5d-2472-4c39-b527-fbedc7d6756d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.573604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.574476 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.574745 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.575016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] PATH_INFO: `/v3/projects/095f289879c94b2faa18e2220a7ce56b/users/12b9a54af46b4d27a539d58b1c60e250/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.590489 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095f289879c94b2faa18e2220a7ce56b, user_id=12b9a54af46b4d27a539d58b1c60e250, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.594951 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.609672 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1402/2842] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:05 2022] PUT /identity/v3/projects/095f289879c94b2faa18e2220a7ce56b/users/12b9a54af46b4d27a539d58b1c60e250/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:50:05.613807 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.624322 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74e19-b23a-4795-b21a-a7ea76db29e4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.680745 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bba87-9565-43e4-aff3-cad0ea6509b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.681424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bba87-9565-43e4-aff3-cad0ea6509b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.681704 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bba87-9565-43e4-aff3-cad0ea6509b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.681973 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bba87-9565-43e4-aff3-cad0ea6509b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.682693 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bba87-9565-43e4-aff3-cad0ea6509b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.684300 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bba87-9565-43e4-aff3-cad0ea6509b8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.697122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1441/2843] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:05.701543 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.712107 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51444a-fe6c-4b5e-80df-0ff6daf45c41 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.718025 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.718918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.719181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.719452 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] PATH_INFO: `/v3/projects/095f289879c94b2faa18e2220a7ce56b/users/12b9a54af46b4d27a539d58b1c60e250/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.721741 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095f289879c94b2faa18e2220a7ce56b, user_id=12b9a54af46b4d27a539d58b1c60e250, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:05.724378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:05.735554 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1403/2844] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:05 2022] PUT /identity/v3/projects/095f289879c94b2faa18e2220a7ce56b/users/12b9a54af46b4d27a539d58b1c60e250/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 05:50:05.800308 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.800930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.800930 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:05.832915 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] MFA Rules not processed for user `12b9a54af46b4d27a539d58b1c60e250`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:05.834063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:05.851571 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:05.903694 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1442/2845] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:05.919454 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:05.921900 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:05.966278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:05.984009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e632cae-1770-4cb5-a3ba-0ac4d4e734b9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:05.988014 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:05.988717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:05.988991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:05.989261 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:06.044122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:06.045597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:06.054436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1404/2846] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:07.570808 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:07.572496 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:07.586035 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201fb73-fe8b-433c-b2f8-3299cf5e2270 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:07.590609 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:07.591263 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:07.591548 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:07.591821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:07.653734 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:07.655894 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:07.666614 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1443/2847] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:08.215810 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:08.225229 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e07db3-8d75-4197-8f30-a243d05f9599 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:08.229290 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d54dab-a401-468e-a8f6-5a38017af72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:08.229941 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d54dab-a401-468e-a8f6-5a38017af72d service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:08.230226 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d54dab-a401-468e-a8f6-5a38017af72d service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:08.230495 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d54dab-a401-468e-a8f6-5a38017af72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:08.240717 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d54dab-a401-468e-a8f6-5a38017af72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:08.242145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d54dab-a401-468e-a8f6-5a38017af72d service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:08.252016 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1405/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:12.125553 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:12.199817 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd537fa5-58d9-4e76-b5ea-924a0864399e service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:12.205683 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:12.206561 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:12.206832 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:12.207101 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] PATH_INFO: `/v3/users/a0cff240f999432da0adb634562801f4` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:12.208425 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cff240f999432da0adb634562801f4)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:12.210489 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:12.259361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cff240f999432da0adb634562801f4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.264676 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:12.273103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cff240f999432da0adb634562801f4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.273800 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cff240f999432da0adb634562801f4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.281755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cff240f999432da0adb634562801f4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.288818 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cff240f999432da0adb634562801f4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.294592 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1444/2849] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:12 2022] DELETE /identity/v3/users/a0cff240f999432da0adb634562801f4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:12.299384 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:12.299853 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:12.299970 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:12.319661 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:12.320839 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:12.386214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1406/2850] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:12.398217 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:12.399761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:12.458501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd43e8d-f474-4054-ba9f-ae68d0a7c3bd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:12.462315 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:12.462957 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:12.463234 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:12.463501 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:12.472759 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:12.474198 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:12.483633 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1445/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:12.773278 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:12.774918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:12.787561 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0042324-4f15-41cf-8afe-edf04945dee6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:12.793505 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:12.794463 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:12.794859 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:12.795177 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] PATH_INFO: `/v3/projects/c31f348ea0c340e787fb0cbb10374fc5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:12.796604 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31f348ea0c340e787fb0cbb10374fc5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:12.798581 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:12.847697 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31f348ea0c340e787fb0cbb10374fc5', 'request_id': 'req-339c8534-f2d3-4372-b6ae-293ec03f31c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.856443 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31f348ea0c340e787fb0cbb10374fc5', 'request_id': 'req-339c8534-f2d3-4372-b6ae-293ec03f31c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.863296 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31f348ea0c340e787fb0cbb10374fc5', 'request_id': 'req-339c8534-f2d3-4372-b6ae-293ec03f31c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.874845 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] The token cache is being invalidate because project c31f348ea0c340e787fb0cbb10374fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:12.875126 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.875736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:12.877299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1407/2852] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:12 2022] DELETE /identity/v3/projects/c31f348ea0c340e787fb0cbb10374fc5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:12.881797 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:12.891975 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066365e-8e0b-485c-b7c2-88b957460593 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:12.957527 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:12.958424 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:12.958701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:12.958999 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] PATH_INFO: `/v3/users/f5e2fdb0428e41a9a83120e6c80830f2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:12.960274 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e2fdb0428e41a9a83120e6c80830f2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:12.962723 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:13.010838 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e2fdb0428e41a9a83120e6c80830f2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.022608 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e2fdb0428e41a9a83120e6c80830f2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.023279 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e2fdb0428e41a9a83120e6c80830f2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.032275 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e2fdb0428e41a9a83120e6c80830f2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.037598 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:13.042016 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e2fdb0428e41a9a83120e6c80830f2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.048772 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1446/2853] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:12 2022] DELETE /identity/v3/users/f5e2fdb0428e41a9a83120e6c80830f2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:13.331732 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:13.333240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:13.341733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:13.347488 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c8534-f2d3-4372-b6ae-293ec03f31c0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:13.411380 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:13.412182 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:13.412465 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:13.412771 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] PATH_INFO: `/v3/projects/fde1368ac2464cf3b365838c61ee486d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:13.414202 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde1368ac2464cf3b365838c61ee486d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:13.416131 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:13.465096 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde1368ac2464cf3b365838c61ee486d', 'request_id': 'req-469f2643-f5fe-4fe5-ba67-3576df1f3171'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.473778 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde1368ac2464cf3b365838c61ee486d', 'request_id': 'req-469f2643-f5fe-4fe5-ba67-3576df1f3171'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.484002 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde1368ac2464cf3b365838c61ee486d', 'request_id': 'req-469f2643-f5fe-4fe5-ba67-3576df1f3171'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.496181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] The token cache is being invalidate because project fde1368ac2464cf3b365838c61ee486d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:13.496468 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.497197 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.498806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1408/2854] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:13 2022] DELETE /identity/v3/projects/fde1368ac2464cf3b365838c61ee486d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:13.503135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:13.504623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:13.519478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b4619-9594-4dd4-bea6-ebfabe73e89b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:13.578392 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:13.579700 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:13.580107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:13.580490 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] PATH_INFO: `/v3/users/12b9a54af46b4d27a539d58b1c60e250` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:13.581860 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b9a54af46b4d27a539d58b1c60e250)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:13.583814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:13.630540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b9a54af46b4d27a539d58b1c60e250'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.642875 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b9a54af46b4d27a539d58b1c60e250'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.643551 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b9a54af46b4d27a539d58b1c60e250'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.651356 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b9a54af46b4d27a539d58b1c60e250'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.658405 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e6183dca-930f-441d-9c58-4e268ac6149f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b9a54af46b4d27a539d58b1c60e250'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:13.664845 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1447/2855] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:13 2022] DELETE /identity/v3/users/12b9a54af46b4d27a539d58b1c60e250 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:13.942840 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:13.944366 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:13.958659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f2643-f5fe-4fe5-ba67-3576df1f3171 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.017102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.017971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.018247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.018511 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] PATH_INFO: `/v3/projects/095f289879c94b2faa18e2220a7ce56b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.019786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] RBAC: Authorizing `identity:delete_project(project_id=095f289879c94b2faa18e2220a7ce56b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.021746 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.061536 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:14.072280 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095f289879c94b2faa18e2220a7ce56b', 'request_id': 'req-823e8d62-2ed5-4f79-a377-23a5cb19698b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:14.080150 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095f289879c94b2faa18e2220a7ce56b', 'request_id': 'req-823e8d62-2ed5-4f79-a377-23a5cb19698b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:14.086325 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095f289879c94b2faa18e2220a7ce56b', 'request_id': 'req-823e8d62-2ed5-4f79-a377-23a5cb19698b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:14.097762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] The token cache is being invalidate because project 095f289879c94b2faa18e2220a7ce56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:14.098049 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:14.099222 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-823e8d62-2ed5-4f79-a377-23a5cb19698b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:14.100973 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1409/2856] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:13 2022] DELETE /identity/v3/projects/095f289879c94b2faa18e2220a7ce56b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:14.107419 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.107715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.107996 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.127172 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:14.128443 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:14.200329 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1448/2857] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:14.208378 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.208673 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.208971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.228666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:14.229878 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:14.238346 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1410/2858] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:14.243272 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.258698 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0995f-bb1c-487e-afb2-93da897170b2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.267703 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.268679 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.269135 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.269409 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.270138 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:50:14.270440 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.272063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.281122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:14.285048 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1449/2859] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:50:14.289806 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.299316 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf753b-cf3a-48a5-a1ae-42c641c45218 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.304857 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.305509 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.305797 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.306070 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.306742 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.308660 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.335178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1411/2860] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:14.339361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.349524 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f491-5722-4c72-a1e1-ffe60c1ad7e3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.408895 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.409626 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.409931 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.410200 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.410880 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.412836 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.435611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1450/2861] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:14.440439 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.455800 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f610-8c2d-45f3-950d-dd8d57962e3a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.460795 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.461472 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.461754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.462041 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.462754 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.464363 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.477065 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1412/2862] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:14.481361 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.492594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c4325-5ed0-424b-b061-f01e4fbab7e4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.498788 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914133be-e5d2-4abb-acfe-28c6d9d4370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.499437 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914133be-e5d2-4abb-acfe-28c6d9d4370d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.499747 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914133be-e5d2-4abb-acfe-28c6d9d4370d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.500017 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914133be-e5d2-4abb-acfe-28c6d9d4370d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.500796 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914133be-e5d2-4abb-acfe-28c6d9d4370d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.502411 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914133be-e5d2-4abb-acfe-28c6d9d4370d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.513584 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1451/2863] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:14.517950 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.528849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b75fd-44af-4e38-bc15-41c2a24508b6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.534460 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.535458 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.535739 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.536009 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] PATH_INFO: `/v3/projects/3ead1ddd77634141821e689ccc6a823e/users/3ca9ff03410f4a1a9397e3e4550ead14/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.550811 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ead1ddd77634141821e689ccc6a823e, user_id=3ca9ff03410f4a1a9397e3e4550ead14, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.553479 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.568394 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1413/2864] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:14 2022] PUT /identity/v3/projects/3ead1ddd77634141821e689ccc6a823e/users/3ca9ff03410f4a1a9397e3e4550ead14/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:14.578814 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.579102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.579377 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.607716 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] MFA Rules not processed for user `3ca9ff03410f4a1a9397e3e4550ead14`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:14.609032 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:14.673107 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1452/2865] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:14.677780 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.739055 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f47a3-4524-4cf0-a6ff-403914bac9bd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.743936 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.744608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.744883 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.745154 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.745831 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.747710 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.777773 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1414/2866] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:14.781998 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.793585 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765daf5-510b-4f2b-a75e-a53bee577f74 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.857102 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.857785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.858063 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.858335 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.859027 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.861074 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.877305 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:14.887503 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1453/2867] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:14 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:14.888733 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.899284 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacfcca-4625-4805-86b3-7edd35c99937 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.904918 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.905613 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.905862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.906161 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.906886 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.908467 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.919249 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1415/2868] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:50:14.923114 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.933737 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc2d11-141a-4fdf-a04f-7613594d4a34 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.939262 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf64ab-7d7a-42fc-9b09-3556b21f78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.939917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf64ab-7d7a-42fc-9b09-3556b21f78a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.940204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf64ab-7d7a-42fc-9b09-3556b21f78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.940509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf64ab-7d7a-42fc-9b09-3556b21f78a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.941230 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf64ab-7d7a-42fc-9b09-3556b21f78a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.942847 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf64ab-7d7a-42fc-9b09-3556b21f78a9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:14.953238 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1454/2869] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:14.957532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:14.967862 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172b759-725e-4a55-a0f1-0ce71854b8e2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:14.973445 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:14.974324 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:14.974599 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:14.974867 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] PATH_INFO: `/v3/projects/56fa63b8dccf41188138c0bf89227dd0/users/e846d4ff4e6347a2bfb7813b92183bbe/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:14.989736 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56fa63b8dccf41188138c0bf89227dd0, user_id=e846d4ff4e6347a2bfb7813b92183bbe, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:14.992326 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.006600 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1416/2870] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:14 2022] PUT /identity/v3/projects/56fa63b8dccf41188138c0bf89227dd0/users/e846d4ff4e6347a2bfb7813b92183bbe/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:15.018243 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.018514 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.018782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.044865 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] MFA Rules not processed for user `e846d4ff4e6347a2bfb7813b92183bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:15.046277 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:15.111697 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1455/2871] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:15.116530 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.127334 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:15.184178 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392e67-1a86-4359-8ea6-2ba1de1a02d0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.189318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.189987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.190257 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.190532 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.191358 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.193436 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.221427 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1417/2872] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:15 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:15.225780 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.237617 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6048-37b5-4353-82de-b1266a914562 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.303917 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.304929 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.305246 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.305638 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.306654 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.309459 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.333699 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1456/2873] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:15 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:15.337783 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.349247 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c289a-811a-422e-85f8-8b1915ffdcae admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.354200 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.354854 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.355132 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.355400 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.356122 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.357892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.369825 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1418/2874] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:15.373992 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.384579 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90874a5-a207-4b16-8b70-ef3ba0392bda admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.389537 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.390417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.390715 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.390987 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] PATH_INFO: `/v3/projects/4ae1bdb3f3c14a7fb8fa4590764b8ecd/users/2043e1cf6f384319a695d599ec9a24c9/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.405969 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae1bdb3f3c14a7fb8fa4590764b8ecd, user_id=2043e1cf6f384319a695d599ec9a24c9, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.408640 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.424261 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1457/2875] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:15 2022] PUT /identity/v3/projects/4ae1bdb3f3c14a7fb8fa4590764b8ecd/users/2043e1cf6f384319a695d599ec9a24c9/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:15.428850 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.443533 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a67a7e-d933-4655-a80c-562c628d3147 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.500693 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da493f-e0fa-4fca-b05a-e0bbb8a229d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.501393 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da493f-e0fa-4fca-b05a-e0bbb8a229d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.501667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da493f-e0fa-4fca-b05a-e0bbb8a229d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.501949 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da493f-e0fa-4fca-b05a-e0bbb8a229d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.502659 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da493f-e0fa-4fca-b05a-e0bbb8a229d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.504426 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da493f-e0fa-4fca-b05a-e0bbb8a229d8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.515195 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1419/2876] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:15.521149 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.532681 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ffb10-a5b9-4c44-8774-ea80acabd501 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.538029 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.538919 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.539197 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.539469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] PATH_INFO: `/v3/projects/4ae1bdb3f3c14a7fb8fa4590764b8ecd/users/2043e1cf6f384319a695d599ec9a24c9/roles/3ccbc80128f444d4a4e5f61e5b10a88f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.541589 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae1bdb3f3c14a7fb8fa4590764b8ecd, user_id=2043e1cf6f384319a695d599ec9a24c9, role_id=3ccbc80128f444d4a4e5f61e5b10a88f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.544248 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.558449 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1458/2877] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:15 2022] PUT /identity/v3/projects/4ae1bdb3f3c14a7fb8fa4590764b8ecd/users/2043e1cf6f384319a695d599ec9a24c9/roles/3ccbc80128f444d4a4e5f61e5b10a88f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:15.573667 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.573967 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.574208 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.602449 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] MFA Rules not processed for user `2043e1cf6f384319a695d599ec9a24c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:15.603666 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:15.678772 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1420/2878] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:15.690701 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:15.693755 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:15.729162 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:15.756209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a1871-968e-4726-a99e-5f936701f90c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:15.760218 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:15.760887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:15.761165 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:15.761438 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:15.817985 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:15.819350 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:15.828366 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1459/2879] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:17.323136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:17.324838 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:17.333757 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:17.338713 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d62bd-854f-4648-9972-b4cd0b6fbfb0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:17.343550 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:17.344180 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:17.344514 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:17.344786 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:17.405318 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:17.406671 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:17.416874 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1421/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:17.955874 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:17.965026 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689317a-8b1f-4e66-bd8c-00bb36e89771 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:17.969209 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c196ee7-48a7-4fb2-9da7-1af889554a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:17.969816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c196ee7-48a7-4fb2-9da7-1af889554a03 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:17.970091 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c196ee7-48a7-4fb2-9da7-1af889554a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:17.970391 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c196ee7-48a7-4fb2-9da7-1af889554a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:17.979642 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c196ee7-48a7-4fb2-9da7-1af889554a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:17.981167 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c196ee7-48a7-4fb2-9da7-1af889554a03 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:17.991154 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1460/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:22.054948 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:22.125830 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba7971-8a6e-4fc2-b382-bba19687081f service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:22.132577 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:22.133446 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:22.133724 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:22.133991 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] PATH_INFO: `/v3/users/3ca9ff03410f4a1a9397e3e4550ead14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:22.135225 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca9ff03410f4a1a9397e3e4550ead14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:22.137209 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:22.186047 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca9ff03410f4a1a9397e3e4550ead14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.194807 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca9ff03410f4a1a9397e3e4550ead14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.195595 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca9ff03410f4a1a9397e3e4550ead14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.203006 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca9ff03410f4a1a9397e3e4550ead14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.203654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca9ff03410f4a1a9397e3e4550ead14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.222401 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1422/2882] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:22 2022] DELETE /identity/v3/users/3ca9ff03410f4a1a9397e3e4550ead14 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:22.227204 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:22.227705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:22.227705 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:22.246139 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:22.247373 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:22.322749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1461/2883] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:22.334264 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:22.335731 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:22.364102 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:22.407959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748eebf-dce5-4014-93ed-7a0771adea81 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:22.411744 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:22.412397 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:22.412711 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:22.412985 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:22.422785 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:22.424256 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:22.434018 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1423/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:22.714509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:22.716116 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:22.730371 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a89e-1166-405d-9b41-37bad8b59992 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:22.735821 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:22.736775 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:22.737215 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:22.738286 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] PATH_INFO: `/v3/projects/3ead1ddd77634141821e689ccc6a823e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:22.740540 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ead1ddd77634141821e689ccc6a823e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:22.744064 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:22.792769 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ead1ddd77634141821e689ccc6a823e', 'request_id': 'req-be70e37b-0524-4163-966d-b5d1e4f3c969'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.798388 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ead1ddd77634141821e689ccc6a823e', 'request_id': 'req-be70e37b-0524-4163-966d-b5d1e4f3c969'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.806967 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ead1ddd77634141821e689ccc6a823e', 'request_id': 'req-be70e37b-0524-4163-966d-b5d1e4f3c969'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.808216 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:22.820394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] The token cache is being invalidate because project 3ead1ddd77634141821e689ccc6a823e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:22.820764 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.821319 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.822864 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1462/2885] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:22 2022] DELETE /identity/v3/projects/3ead1ddd77634141821e689ccc6a823e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:22.826913 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:22.836852 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a7ec3-7769-4781-9ca8-88a76d8797eb service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:22.894632 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:22.895507 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:22.895842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:22.896088 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] PATH_INFO: `/v3/users/e846d4ff4e6347a2bfb7813b92183bbe` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:22.897403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e846d4ff4e6347a2bfb7813b92183bbe)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:22.899314 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:22.954709 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e846d4ff4e6347a2bfb7813b92183bbe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.962699 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e846d4ff4e6347a2bfb7813b92183bbe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.963396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e846d4ff4e6347a2bfb7813b92183bbe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.970895 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e846d4ff4e6347a2bfb7813b92183bbe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.971522 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e846d4ff4e6347a2bfb7813b92183bbe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:22.989302 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1424/2886] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:22 2022] DELETE /identity/v3/users/e846d4ff4e6347a2bfb7813b92183bbe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:23.291795 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:23.293358 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:23.307156 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70e37b-0524-4163-966d-b5d1e4f3c969 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:23.368762 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:23.369761 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:23.370066 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:23.370458 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] PATH_INFO: `/v3/projects/56fa63b8dccf41188138c0bf89227dd0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:23.371674 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56fa63b8dccf41188138c0bf89227dd0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:23.373644 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:23.421339 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56fa63b8dccf41188138c0bf89227dd0', 'request_id': 'req-1d845dc1-fc76-4c75-9c83-4f8034775fe3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.427252 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56fa63b8dccf41188138c0bf89227dd0', 'request_id': 'req-1d845dc1-fc76-4c75-9c83-4f8034775fe3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.436134 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56fa63b8dccf41188138c0bf89227dd0', 'request_id': 'req-1d845dc1-fc76-4c75-9c83-4f8034775fe3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.447746 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] The token cache is being invalidate because project 56fa63b8dccf41188138c0bf89227dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:23.448033 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.448789 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.450417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1463/2887] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:23 2022] DELETE /identity/v3/projects/56fa63b8dccf41188138c0bf89227dd0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:23.454728 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:23.456212 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:23.469135 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc62638-47b6-43e9-a2e2-1022f249bbe1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:23.518541 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:23.539240 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:23.540123 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:23.540402 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:23.540700 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] PATH_INFO: `/v3/users/2043e1cf6f384319a695d599ec9a24c9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:23.541959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2043e1cf6f384319a695d599ec9a24c9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:23.543927 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:23.592090 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2043e1cf6f384319a695d599ec9a24c9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.599549 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2043e1cf6f384319a695d599ec9a24c9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.600183 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2043e1cf6f384319a695d599ec9a24c9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.607172 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2043e1cf6f384319a695d599ec9a24c9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.607784 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca1e637a-75ad-4a86-9e31-0c7138a45190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2043e1cf6f384319a695d599ec9a24c9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:23.625362 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1425/2888] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:23 2022] DELETE /identity/v3/users/2043e1cf6f384319a695d599ec9a24c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:23.902061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:23.903594 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:23.918294 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d845dc1-fc76-4c75-9c83-4f8034775fe3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:23.975968 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:23.976903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:23.977186 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:23.977460 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] PATH_INFO: `/v3/projects/4ae1bdb3f3c14a7fb8fa4590764b8ecd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:23.978647 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae1bdb3f3c14a7fb8fa4590764b8ecd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:23.980625 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.013623 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:24.031478 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae1bdb3f3c14a7fb8fa4590764b8ecd', 'request_id': 'req-e89e9d8e-9191-4cca-a833-de211dace7ff'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.036771 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae1bdb3f3c14a7fb8fa4590764b8ecd', 'request_id': 'req-e89e9d8e-9191-4cca-a833-de211dace7ff'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.045672 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae1bdb3f3c14a7fb8fa4590764b8ecd', 'request_id': 'req-e89e9d8e-9191-4cca-a833-de211dace7ff'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.057805 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] The token cache is being invalidate because project 4ae1bdb3f3c14a7fb8fa4590764b8ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:24.058061 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.058670 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e89e9d8e-9191-4cca-a833-de211dace7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.060174 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1464/2889] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:23 2022] DELETE /identity/v3/projects/4ae1bdb3f3c14a7fb8fa4590764b8ecd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:24.065233 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.065523 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.065794 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.084003 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:24.085215 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:24.149925 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1426/2890] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:24.162611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.162869 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.163177 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.182372 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:24.183558 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:24.191689 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1465/2891] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:24.196038 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.206037 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee68bb-bc9b-4a14-b6c9-1f0de4ef0798 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.211636 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.212299 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.212608 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.212880 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.214004 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 05:50:24.214420 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.216597 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.228816 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1427/2892] 10.222.0.18 () {58 vars in 1152 bytes} [Thu Jul 21 05:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 05:50:24.234323 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.244658 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f24efc-b014-440e-bc6b-73f9f7cdc03b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.249782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.250469 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.250749 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.251019 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.251801 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.253779 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.286986 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1466/2893] 10.222.0.18 () {60 vars in 1152 bytes} [Thu Jul 21 05:50:24 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:24.291120 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.301987 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0641665-d40c-4197-aede-10704b1151bf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.362271 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:24.373654 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.374333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.374616 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.374919 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.375611 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.377606 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.400141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1428/2894] 10.222.0.18 () {60 vars in 1143 bytes} [Thu Jul 21 05:50:24 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 05:50:24.404750 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.415646 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dcfc5-73a3-4cd8-9175-44bcaa977f8f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.420429 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.421122 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.421407 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.421667 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.422394 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.424002 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.434905 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1467/2895] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 05:50:24.439098 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.449971 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef90ec-34b6-4e96-afc3-1380820ccdff admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.455050 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5940220-78af-439c-88f1-a7e091b3201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.455774 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5940220-78af-439c-88f1-a7e091b3201c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.456059 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5940220-78af-439c-88f1-a7e091b3201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.456333 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5940220-78af-439c-88f1-a7e091b3201c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.457151 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5940220-78af-439c-88f1-a7e091b3201c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.458823 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5940220-78af-439c-88f1-a7e091b3201c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.469064 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1429/2896] 10.222.0.18 () {58 vars in 1121 bytes} [Thu Jul 21 05:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 05:50:24.473222 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.483611 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612def6-bbde-4de9-a256-2758cb95db4f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.488760 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.489782 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.490060 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.490375 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] PATH_INFO: `/v3/projects/2e8c76fed1e64188bd835550e9ccb28f/users/b4c937d77d7d4641835ba38604231a49/roles/5cf5c09e27ba4efeb3ffdc17f4a11668` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.505691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8c76fed1e64188bd835550e9ccb28f, user_id=b4c937d77d7d4641835ba38604231a49, role_id=5cf5c09e27ba4efeb3ffdc17f4a11668)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.508417 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.522934 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1468/2897] 10.222.0.18 () {60 vars in 1482 bytes} [Thu Jul 21 05:50:24 2022] PUT /identity/v3/projects/2e8c76fed1e64188bd835550e9ccb28f/users/b4c937d77d7d4641835ba38604231a49/roles/5cf5c09e27ba4efeb3ffdc17f4a11668 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:24.533558 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.533842 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.534115 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.560656 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] MFA Rules not processed for user `b4c937d77d7d4641835ba38604231a49`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:24.561864 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:24.645751 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1430/2898] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:24.657355 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.659406 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:24.719103 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b735c4-3fb4-48f0-b369-bc1510dc40ed admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.722876 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d881-4098-45ec-b12b-3c74e36cec5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '535729140fea45e99aa556d85913ae08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.723509 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d881-4098-45ec-b12b-3c74e36cec5c service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.723785 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d881-4098-45ec-b12b-3c74e36cec5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.724034 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d881-4098-45ec-b12b-3c74e36cec5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.737374 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d881-4098-45ec-b12b-3c74e36cec5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.739717 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d881-4098-45ec-b12b-3c74e36cec5c service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.748938 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1469/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:24.773805 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:24.838984 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db85da-208b-4219-85d0-2667fee3a2e7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:24.844403 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:24.845328 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.845603 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.845892 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] PATH_INFO: `/v3/users/b4c937d77d7d4641835ba38604231a49` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.847136 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c937d77d7d4641835ba38604231a49)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:24.849145 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:24.896909 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c937d77d7d4641835ba38604231a49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.906399 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c937d77d7d4641835ba38604231a49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.907141 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c937d77d7d4641835ba38604231a49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.912908 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:24.915001 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c937d77d7d4641835ba38604231a49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.915849 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c937d77d7d4641835ba38604231a49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:24.935473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1431/2900] 10.222.0.18 () {58 vars in 1223 bytes} [Thu Jul 21 05:50:24 2022] DELETE /identity/v3/users/b4c937d77d7d4641835ba38604231a49 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:24.940043 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:24.940330 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:24.940630 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:24.959320 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] MFA Rules not processed for user `0df58371c35d43d69765edab78a9d01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 05:50:24.960543 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:25.007887 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:25.022191 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1470/2901] 10.222.0.18 () {58 vars in 957 bytes} [Thu Jul 21 05:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 05:50:25.032217 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:25.033750 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:25.096767 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3d23-62a8-40af-9501-1f86b9ee3e5e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:25.101765 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd3a6e312242f5a0bfbcaa90359732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:25.102415 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:25.102692 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:25.102959 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:25.113214 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:25.114624 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:25.124181 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1432/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:50:25.407089 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:50:25.409765 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:50:25.422385 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe34a24-329a-4787-89d8-b0e8535bb6fe None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:50:25.429816 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0df58371c35d43d69765edab78a9d01a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cee36c3beac431ba01428ee854cc3a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:50:25.430721 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:50:25.430984 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:50:25.431255 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] PATH_INFO: `/v3/projects/2e8c76fed1e64188bd835550e9ccb28f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:50:25.432691 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8c76fed1e64188bd835550e9ccb28f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:50:25.434510 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:50:25.483124 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8c76fed1e64188bd835550e9ccb28f', 'request_id': 'req-f099ac69-24e4-485e-a4dc-5cee955c0e06'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:25.488902 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8c76fed1e64188bd835550e9ccb28f', 'request_id': 'req-f099ac69-24e4-485e-a4dc-5cee955c0e06'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:25.497856 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8c76fed1e64188bd835550e9ccb28f', 'request_id': 'req-f099ac69-24e4-485e-a4dc-5cee955c0e06'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:25.509994 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] The token cache is being invalidate because project 2e8c76fed1e64188bd835550e9ccb28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 05:50:25.510281 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:25.510925 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f099ac69-24e4-485e-a4dc-5cee955c0e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 05:50:25.512515 dv-cinder-850449-1-smb devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1471/2903] 10.222.0.18 () {58 vars in 1232 bytes} [Thu Jul 21 05:50:25 2022] DELETE /identity/v3/projects/2e8c76fed1e64188bd835550e9ccb28f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 05:50:35.119910 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=34,keystone:DELETE=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:35.506903 dv-cinder-850449-1-smb devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:06.654291 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 05:53:06.656071 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:53:06.728542 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c999ad-8385-4041-932a-8f45c907de32 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 05:53:06.795762 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2181bb81957a46e6ae1fccf0b32e66fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53e2ae4f4589424abfc724399c55ab86', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 05:53:06.796396 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 05:53:06.796707 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 05:53:06.796953 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 05:53:06.799133 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 05:53:06.810841 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 05:53:06.812434 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdc13-23da-49c1-a7c9-c650ca7c0565 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 05:53:06.822473 dv-cinder-850449-1-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1433/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Thu Jul 21 05:53:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 05:53:16.818447 dv-cinder-850449-1-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=58 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}